2026-02-18T00:02:49.198 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T00:02:49.212 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T00:02:49.290 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54106 branch: 20.2.1_2.17.26-baseline_2 description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '54106' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: 20.2.1_2.17.26-baseline_2 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed workunit: branch: 20.2.1_2.17.26-baseline_2 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1775 sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: 20.2.1_2.17.26-baseline_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed targets: trial061.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJhAcI88Y+3PBb7688IPWXLSIZAgNBjWy74w/YvUW6cO1XzTGRK2HviUnp7LOo1RIEXaIXviISJL0O4iEW9CS4s= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - erasure-code teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_21:14:21 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T00:02:49.290 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa; will attempt to use it 2026-02-18T00:02:49.290 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_adc1923395f2bcd6ae89b5d331d278364d1848ed/qa/tasks 2026-02-18T00:02:49.290 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T00:02:49.292 INFO:teuthology.task.internal:Checking packages... 2026-02-18T00:02:49.292 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'adc1923395f2bcd6ae89b5d331d278364d1848ed' 2026-02-18T00:02:49.292 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T00:02:49.292 INFO:teuthology.packaging:ref: None 2026-02-18T00:02:49.292 INFO:teuthology.packaging:tag: None 2026-02-18T00:02:49.292 INFO:teuthology.packaging:branch: 20.2.1_2.17.26-baseline_2 2026-02-18T00:02:49.292 INFO:teuthology.packaging:sha1: adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:02:49.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=20.2.1_2.17.26-baseline_2 2026-02-18T00:02:49.410 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-670.gadc19233 2026-02-18T00:02:49.412 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T00:02:49.423 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T00:02:49.423 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T00:02:49.436 INFO:teuthology.task.internal:Saving configuration 2026-02-18T00:02:49.441 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T00:02:49.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T00:02:49.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial061.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54106', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 23:59:26.942374', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJhAcI88Y+3PBb7688IPWXLSIZAgNBjWy74w/YvUW6cO1XzTGRK2HviUnp7LOo1RIEXaIXviISJL0O4iEW9CS4s='} 2026-02-18T00:02:49.534 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T00:02:49.544 INFO:teuthology.task.internal:roles: ubuntu@trial061.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-18T00:02:49.544 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T00:02:49.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x74d8687de200>, signals=[15]) 2026-02-18T00:02:49.628 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T00:02:49.642 INFO:teuthology.task.internal:Opening connections... 2026-02-18T00:02:49.642 DEBUG:teuthology.task.internal:connecting to ubuntu@trial061.front.sepia.ceph.com 2026-02-18T00:02:49.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:02:49.761 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T00:02:49.772 DEBUG:teuthology.orchestra.run.trial061:> uname -m 2026-02-18T00:02:49.837 INFO:teuthology.orchestra.run.trial061.stdout:x86_64 2026-02-18T00:02:49.837 DEBUG:teuthology.orchestra.run.trial061:> cat /etc/os-release 2026-02-18T00:02:49.893 INFO:teuthology.orchestra.run.trial061.stdout:NAME="CentOS Stream" 2026-02-18T00:02:49.893 INFO:teuthology.orchestra.run.trial061.stdout:VERSION="9" 2026-02-18T00:02:49.893 INFO:teuthology.orchestra.run.trial061.stdout:ID="centos" 2026-02-18T00:02:49.893 INFO:teuthology.orchestra.run.trial061.stdout:ID_LIKE="rhel fedora" 2026-02-18T00:02:49.893 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_ID="9" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:PLATFORM_ID="platform:el9" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:ANSI_COLOR="0;31" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:LOGO="fedora-logo-icon" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:HOME_URL="https://centos.org/" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T00:02:49.894 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T00:02:49.895 INFO:teuthology.lock.ops:Updating trial061.front.sepia.ceph.com on lock server 2026-02-18T00:02:50.147 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T00:02:50.160 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T00:02:50.172 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T00:02:50.172 DEBUG:teuthology.orchestra.run.trial061:> test '!' -e /home/ubuntu/cephtest 2026-02-18T00:02:50.187 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T00:02:50.198 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T00:02:50.198 DEBUG:teuthology.orchestra.run.trial061:> test -z $(ls -A /var/lib/ceph) 2026-02-18T00:02:50.245 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T00:02:50.358 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T00:02:50.377 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-18T00:02:50.377 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-18T00:02:50.377 DEBUG:teuthology.orchestra.run.trial061:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T00:02:50.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:02:50.392 DEBUG:teuthology.orchestra.run.trial061:> uname -r 2026-02-18T00:02:50.448 INFO:teuthology.orchestra.run.trial061.stdout:5.14.0-645.el9.x86_64 2026-02-18T00:02:50.448 INFO:teuthology.task.kernel:Running kernel on trial061: 5.14.0-645.el9.x86_64 2026-02-18T00:02:50.448 DEBUG:teuthology.orchestra.run.trial061:> sudo yum install -y kernel 2026-02-18T00:02:51.672 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-18T00:02:55.452 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-18T00:02:58.897 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-18T00:02:59.843 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 20 kB 00:00 2026-02-18T00:03:02.005 INFO:teuthology.orchestra.run.trial061.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 20 MB 00:02 2026-02-18T00:03:05.316 INFO:teuthology.orchestra.run.trial061.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-18T00:03:06.334 INFO:teuthology.orchestra.run.trial061.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T00:03:06.356 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:03:06.357 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:03:06.357 INFO:teuthology.orchestra.run.trial061.stdout: Package Architecture Version Repository Size 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout:Installing dependencies: 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:03:06.358 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:03:06.359 INFO:teuthology.orchestra.run.trial061.stdout:Install 4 Packages 2026-02-18T00:03:06.359 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:06.359 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 88 M 2026-02-18T00:03:06.359 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 135 M 2026-02-18T00:03:06.359 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:03:07.251 INFO:teuthology.orchestra.run.trial061.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-18T00:03:07.828 INFO:teuthology.orchestra.run.trial061.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-18T00:03:08.307 INFO:teuthology.orchestra.run.trial061.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-18T00:03:08.467 INFO:teuthology.orchestra.run.trial061.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-18T00:03:08.467 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:03:08.467 INFO:teuthology.orchestra.run.trial061.stdout:Total 42 MB/s | 88 MB 00:02 2026-02-18T00:03:08.660 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:03:08.867 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:03:08.868 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:03:09.216 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:03:09.216 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:03:10.303 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:03:10.584 INFO:teuthology.orchestra.run.trial061.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-18T00:03:10.602 INFO:teuthology.orchestra.run.trial061.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T00:03:12.386 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T00:03:12.415 INFO:teuthology.orchestra.run.trial061.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T00:03:15.504 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T00:03:15.510 INFO:teuthology.orchestra.run.trial061.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:18.544 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:48.993 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:49.014 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:49.080 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:49.080 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-18T00:03:49.080 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-18T00:03:49.080 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-18T00:03:49.132 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:49.133 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:03:49.193 DEBUG:teuthology.orchestra.run.trial061:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T00:03:49.219 INFO:teuthology.orchestra.run.trial061.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.220 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T00:03:49.221 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-18T00:03:49.221 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-18T00:03:49.221 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-18T00:03:49.221 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-18T00:03:49.221 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial061.front.sepia.ceph.com, path=None, version=distro) 2026-02-18T00:03:49.221 DEBUG:teuthology.orchestra.run.trial061:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T00:03:49.286 INFO:teuthology.orchestra.run.trial061.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.287 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T00:03:49.287 DEBUG:teuthology.orchestra.run.trial061:> sudo rpm -qi grub2-tools 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Name : grub2-tools 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Epoch : 1 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Version : 2.06 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Release : 118.el9 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Architecture: x86_64 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Group : Unspecified 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Size : 8393909 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:License : GPLv3+ 2026-02-18T00:03:49.358 INFO:teuthology.orchestra.run.trial061.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Packager : builder@centos.org 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Vendor : CentOS 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Summary : Support tools for GRUB. 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:Description : 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-18T00:03:49.359 INFO:teuthology.orchestra.run.trial061.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-18T00:03:49.360 INFO:teuthology.orchestra.run.trial061.stdout:hardware devices. 2026-02-18T00:03:49.360 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:03:49.360 INFO:teuthology.orchestra.run.trial061.stdout:This subpackage provides tools for support of all platforms. 2026-02-18T00:03:49.361 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-18T00:03:49.361 INFO:teuthology.task.kernel:Updating grub on trial061 to boot 5.14.0-681.el9.x86_64 2026-02-18T00:03:49.361 DEBUG:teuthology.orchestra.run.trial061:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-18T00:03:49.425 INFO:teuthology.orchestra.run.trial061.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T00:03:49.427 DEBUG:teuthology.orchestra.run.trial061:> sudo command -v grubby && echo yes || echo no 2026-02-18T00:03:49.491 INFO:teuthology.orchestra.run.trial061.stdout:/sbin/grubby 2026-02-18T00:03:49.492 INFO:teuthology.orchestra.run.trial061.stdout:yes 2026-02-18T00:03:49.493 DEBUG:teuthology.orchestra.run.trial061:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-18T00:03:49.558 INFO:teuthology.orchestra.run.trial061.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-18T00:03:49.559 DEBUG:teuthology.orchestra.run.trial061:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.631 DEBUG:teuthology.orchestra.run.trial061:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-18T00:03:49.845 INFO:teuthology.orchestra.run.trial061.stderr:Generating grub configuration file ... 2026-02-18T00:03:49.908 INFO:teuthology.orchestra.run.trial061.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-18T00:03:49.914 INFO:teuthology.orchestra.run.trial061.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-18T00:03:50.165 INFO:teuthology.orchestra.run.trial061.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-18T00:03:50.171 INFO:teuthology.orchestra.run.trial061.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-18T00:03:50.203 INFO:teuthology.orchestra.run.trial061.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-18T00:03:50.209 INFO:teuthology.orchestra.run.trial061.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-18T00:03:50.232 INFO:teuthology.orchestra.run.trial061.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-18T00:03:50.239 INFO:teuthology.orchestra.run.trial061.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-18T00:03:50.323 INFO:teuthology.orchestra.run.trial061.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-18T00:03:50.332 INFO:teuthology.orchestra.run.trial061.stderr:done 2026-02-18T00:03:50.334 DEBUG:teuthology.orchestra.run.trial061:> test -d /sys/firmware/efi 2026-02-18T00:03:50.350 DEBUG:teuthology.orchestra.run.trial061:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-18T00:03:50.416 INFO:teuthology.orchestra.run.trial061.stdout:/boot/efi/EFI/BOOT 2026-02-18T00:03:50.417 INFO:teuthology.orchestra.run.trial061.stdout:/boot/efi/EFI/centos 2026-02-18T00:03:50.418 DEBUG:teuthology.orchestra.run.trial061:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-18T00:03:50.483 INFO:teuthology.orchestra.run.trial061.stdout:no 2026-02-18T00:03:50.483 DEBUG:teuthology.orchestra.run.trial061:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-18T00:03:50.547 INFO:teuthology.orchestra.run.trial061.stdout:yes 2026-02-18T00:03:50.547 DEBUG:teuthology.orchestra.run.trial061:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-18T00:03:50.611 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial061 2026-02-18T00:03:50.611 DEBUG:teuthology.orchestra.run.trial061:> sudo bash -c ' 2026-02-18T00:03:50.611 DEBUG:teuthology.orchestra.run.trial061:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-18T00:03:50.611 DEBUG:teuthology.orchestra.run.trial061:> ' 2026-02-18T00:04:20.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-18T00:04:20.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-18T00:04:20.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:04:34.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.61 2026-02-18T00:04:43.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-18T00:04:43.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:05:20.002 DEBUG:teuthology.orchestra.run.trial061:> true 2026-02-18T00:05:20.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-18T00:05:20.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-18T00:05:20.165 DEBUG:teuthology.orchestra.run.trial061:> uname -r 2026-02-18T00:05:20.222 INFO:teuthology.orchestra.run.trial061.stdout:5.14.0-681.el9.x86_64 2026-02-18T00:05:20.223 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-18T00:05:20.223 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-18T00:05:20.223 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-18T00:05:21.224 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-18T00:05:21.225 DEBUG:teuthology.orchestra.run.trial061:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-18T00:05:21.254 INFO:teuthology.orchestra.run.trial061.stdout:ttyS1 2026-02-18T00:05:21.275 DEBUG:teuthology.parallel:result is None 2026-02-18T00:05:21.275 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T00:05:21.287 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T00:05:21.287 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T00:05:21.332 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T00:05:21.343 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T00:05:21.358 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T00:05:21.358 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T00:05:21.397 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T00:05:21.409 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T00:05:21.409 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T00:05:21.457 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:05:21.466 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:05:21.467 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T00:05:21.483 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T00:05:21.483 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T00:05:21.531 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T00:05:21.549 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T00:05:21.549 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T00:05:21.587 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T00:05:21.748 DEBUG:teuthology.orchestra.run.trial061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T00:05:21.772 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T00:05:21.922 DEBUG:teuthology.orchestra.run.trial061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T00:05:21.947 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:05:21.947 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T00:05:22.020 DEBUG:teuthology.orchestra.run.trial061:> sudo service rsyslog restart 2026-02-18T00:05:22.095 INFO:teuthology.orchestra.run.trial061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T00:05:22.478 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T00:05:22.491 INFO:teuthology.task.internal:Starting timer... 2026-02-18T00:05:22.491 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T00:05:22.516 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T00:05:22.536 DEBUG:teuthology.orchestra.run.trial061:> sudo service auditd rotate 2026-02-18T00:05:22.566 INFO:teuthology.orchestra.run.trial061.stdout:Rotating logs: 2026-02-18T00:05:22.568 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T00:05:22.568 DEBUG:teuthology.orchestra.run.trial061:> /usr/sbin/getenforce 2026-02-18T00:05:22.625 INFO:teuthology.orchestra.run.trial061.stdout:Permissive 2026-02-18T00:05:22.625 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial061.front.sepia.ceph.com': 'permissive'} 2026-02-18T00:05:22.626 DEBUG:teuthology.orchestra.run.trial061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T00:05:22.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:05:22.690 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T00:05:22.690 DEBUG:teuthology.orchestra.run.trial061:> sudo /usr/sbin/setenforce permissive 2026-02-18T00:05:22.753 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T00:05:22.770 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T00:05:22.780 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T00:05:22.781 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial061.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T00:06:32.562 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial061.front.sepia.ceph.com')] 2026-02-18T00:06:32.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-18T00:06:32.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T00:06:32.650 DEBUG:teuthology.orchestra.run.trial061:> true 2026-02-18T00:06:32.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-18T00:06:32.732 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T00:06:32.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T00:06:32.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T00:06:32.746 DEBUG:teuthology.orchestra.run.trial061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T00:06:32.798 INFO:teuthology.orchestra.run.trial061.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T00:06:32.810 INFO:teuthology.orchestra.run.trial061.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T00:06:32.831 INFO:teuthology.orchestra.run.trial061.stderr:sudo: ntpd: command not found 2026-02-18T00:06:32.840 INFO:teuthology.orchestra.run.trial061.stdout:506 Cannot talk to daemon 2026-02-18T00:06:32.852 INFO:teuthology.orchestra.run.trial061.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T00:06:32.864 INFO:teuthology.orchestra.run.trial061.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T00:06:32.915 INFO:teuthology.orchestra.run.trial061.stderr:bash: line 1: ntpq: command not found 2026-02-18T00:06:32.934 INFO:teuthology.orchestra.run.trial061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T00:06:32.934 INFO:teuthology.orchestra.run.trial061.stdout:=============================================================================== 2026-02-18T00:06:32.935 INFO:teuthology.orchestra.run.trial061.stdout:^? time-usw1.crimpac.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T00:06:32.935 INFO:teuthology.orchestra.run.trial061.stdout:^? chi2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T00:06:32.935 INFO:teuthology.orchestra.run.trial061.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T00:06:32.935 INFO:teuthology.orchestra.run.trial061.stdout:^? 172-104-209-204.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T00:06:32.936 INFO:teuthology.run_tasks:Running task install... 2026-02-18T00:06:32.950 DEBUG:teuthology.task.install:project ceph 2026-02-18T00:06:32.951 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'}} 2026-02-18T00:06:32.951 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed'} 2026-02-18T00:06:32.951 INFO:teuthology.task.install:Using flavor: default 2026-02-18T00:06:32.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T00:06:32.959 INFO:teuthology.task.install:extra packages: [] 2026-02-18T00:06:32.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'adc1923395f2bcd6ae89b5d331d278364d1848ed', 'tag': None, 'wait_for_package': False} 2026-02-18T00:06:32.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:06:33.125 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/ 2026-02-18T00:06:33.125 INFO:teuthology.task.install.rpm:Package version is 20.2.0-670.gadc19233 2026-02-18T00:06:33.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/20.2.1_2.17.26-baseline_2/adc1923395f2bcd6ae89b5d331d278364d1848ed/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T00:06:33.278 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:06:33.278 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T00:06:33.303 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-18T00:06:33.303 DEBUG:teuthology.orchestra.run.trial061:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/adc1923395f2bcd6ae89b5d331d278364d1848ed/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T00:06:33.367 DEBUG:teuthology.orchestra.run.trial061:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T00:06:33.439 DEBUG:teuthology.orchestra.run.trial061:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T00:06:33.504 INFO:teuthology.orchestra.run.trial061.stdout:check_obsoletes = 1 2026-02-18T00:06:33.506 DEBUG:teuthology.orchestra.run.trial061:> sudo yum clean all 2026-02-18T00:06:33.654 INFO:teuthology.orchestra.run.trial061.stdout:41 files removed 2026-02-18T00:06:33.668 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-radosgw 2026-02-18T00:06:33.940 INFO:teuthology.orchestra.run.trial061.stdout:ceph packages for x86_64 702 kB/s | 89 kB 00:00 2026-02-18T00:06:34.080 INFO:teuthology.orchestra.run.trial061.stdout:ceph noarch packages 162 kB/s | 19 kB 00:00 2026-02-18T00:06:34.206 INFO:teuthology.orchestra.run.trial061.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-18T00:06:35.293 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.9 MB 00:01 2026-02-18T00:06:38.528 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-18T00:06:49.681 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - CRB 904 kB/s | 7.8 MB 00:08 2026-02-18T00:06:50.629 INFO:teuthology.orchestra.run.trial061.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 20 kB 00:00 2026-02-18T00:06:52.218 INFO:teuthology.orchestra.run.trial061.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-18T00:06:55.407 INFO:teuthology.orchestra.run.trial061.stdout:lab-extras 927 kB/s | 50 kB 00:00 2026-02-18T00:06:56.640 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repository Size 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout: ceph-radosgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout:Upgrading: 2026-02-18T00:06:56.642 INFO:teuthology.orchestra.run.trial061.stdout: librados2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 3.5 M 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: librbd1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.8 M 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout:Installing dependencies: 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: ceph-base x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.9 M 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 M 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: ceph-selinux x86_64 2:20.2.0-670.gadc19233.el9 ceph 25 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 869 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T00:06:56.643 INFO:teuthology.orchestra.run.trial061.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: libradosstriper1 x86_64 2:20.2.0-670.gadc19233.el9 ceph 250 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: librgw2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.4 M 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T00:06:56.644 INFO:teuthology.orchestra.run.trial061.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-argparse x86_64 2:20.2.0-670.gadc19233.el9 ceph 45 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-common x86_64 2:20.2.0-670.gadc19233.el9 ceph 175 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-cephfs x86_64 2:20.2.0-670.gadc19233.el9 ceph 162 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-rados x86_64 2:20.2.0-670.gadc19233.el9 ceph 323 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-rbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 305 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: python3-rgw x86_64 2:20.2.0-670.gadc19233.el9 ceph 99 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T00:06:56.645 INFO:teuthology.orchestra.run.trial061.stdout:Installing weak dependencies: 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-daemon x86_64 2:20.2.0-670.gadc19233.el9 ceph 35 k 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-proxy2 x86_64 2:20.2.0-670.gadc19233.el9 ceph 24 k 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout:Install 35 Packages 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout:Upgrade 2 Packages 2026-02-18T00:06:56.646 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:06:56.647 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 79 M 2026-02-18T00:06:56.647 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:06:57.503 INFO:teuthology.orchestra.run.trial061.stdout:(1/37): ceph-base-20.2.0-670.gadc19233.el9.x86_ 17 MB/s | 5.9 MB 00:00 2026-02-18T00:06:57.537 INFO:teuthology.orchestra.run.trial061.stdout:(2/37): ceph-selinux-20.2.0-670.gadc19233.el9.x 755 kB/s | 25 kB 00:00 2026-02-18T00:06:57.575 INFO:teuthology.orchestra.run.trial061.stdout:(3/37): libcephfs-daemon-20.2.0-670.gadc19233.e 915 kB/s | 35 kB 00:00 2026-02-18T00:06:57.611 INFO:teuthology.orchestra.run.trial061.stdout:(4/37): libcephfs-proxy2-20.2.0-670.gadc19233.e 681 kB/s | 24 kB 00:00 2026-02-18T00:06:57.664 INFO:teuthology.orchestra.run.trial061.stdout:(5/37): libcephfs2-20.2.0-670.gadc19233.el9.x86 16 MB/s | 869 kB 00:00 2026-02-18T00:06:57.704 INFO:teuthology.orchestra.run.trial061.stdout:(6/37): libradosstriper1-20.2.0-670.gadc19233.e 6.0 MB/s | 250 kB 00:00 2026-02-18T00:06:58.056 INFO:teuthology.orchestra.run.trial061.stdout:(7/37): librgw2-20.2.0-670.gadc19233.el9.x86_64 18 MB/s | 6.4 MB 00:00 2026-02-18T00:06:58.083 INFO:teuthology.orchestra.run.trial061.stdout:(8/37): python3-ceph-argparse-20.2.0-670.gadc19 1.6 MB/s | 45 kB 00:00 2026-02-18T00:06:58.117 INFO:teuthology.orchestra.run.trial061.stdout:(9/37): python3-ceph-common-20.2.0-670.gadc1923 5.0 MB/s | 175 kB 00:00 2026-02-18T00:06:58.155 INFO:teuthology.orchestra.run.trial061.stdout:(10/37): ceph-common-20.2.0-670.gadc19233.el9.x 24 MB/s | 24 MB 00:01 2026-02-18T00:06:58.156 INFO:teuthology.orchestra.run.trial061.stdout:(11/37): python3-cephfs-20.2.0-670.gadc19233.el 4.0 MB/s | 162 kB 00:00 2026-02-18T00:06:58.172 INFO:teuthology.orchestra.run.trial061.stdout:(12/37): python3-rados-20.2.0-670.gadc19233.el9 19 MB/s | 323 kB 00:00 2026-02-18T00:06:58.177 INFO:teuthology.orchestra.run.trial061.stdout:(13/37): python3-rbd-20.2.0-670.gadc19233.el9.x 15 MB/s | 305 kB 00:00 2026-02-18T00:06:58.188 INFO:teuthology.orchestra.run.trial061.stdout:(14/37): python3-rgw-20.2.0-670.gadc19233.el9.x 6.1 MB/s | 99 kB 00:00 2026-02-18T00:06:58.243 INFO:teuthology.orchestra.run.trial061.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 499 kB/s | 33 kB 00:00 2026-02-18T00:06:58.287 INFO:teuthology.orchestra.run.trial061.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-18T00:06:58.309 INFO:teuthology.orchestra.run.trial061.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 4.5 MB/s | 104 kB 00:00 2026-02-18T00:06:58.316 INFO:teuthology.orchestra.run.trial061.stdout:(18/37): nvme-cli-2.13-1.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2026-02-18T00:06:58.333 INFO:teuthology.orchestra.run.trial061.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 6.8 MB/s | 164 kB 00:00 2026-02-18T00:06:58.339 INFO:teuthology.orchestra.run.trial061.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.7 MB/s | 160 kB 00:00 2026-02-18T00:06:58.355 INFO:teuthology.orchestra.run.trial061.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-18T00:06:58.394 INFO:teuthology.orchestra.run.trial061.stdout:(22/37): ceph-radosgw-20.2.0-670.gadc19233.el9. 19 MB/s | 24 MB 00:01 2026-02-18T00:06:58.395 INFO:teuthology.orchestra.run.trial061.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 12 MB/s | 662 kB 00:00 2026-02-18T00:06:58.396 INFO:teuthology.orchestra.run.trial061.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 7.0 MB/s | 292 kB 00:00 2026-02-18T00:06:58.418 INFO:teuthology.orchestra.run.trial061.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-18T00:06:58.418 INFO:teuthology.orchestra.run.trial061.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-18T00:06:58.479 INFO:teuthology.orchestra.run.trial061.stdout:(27/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-18T00:06:58.737 INFO:teuthology.orchestra.run.trial061.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 96 kB/s | 25 kB 00:00 2026-02-18T00:06:58.859 INFO:teuthology.orchestra.run.trial061.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 400 kB/s | 49 kB 00:00 2026-02-18T00:06:58.890 INFO:teuthology.orchestra.run.trial061.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 652 kB/s | 308 kB 00:00 2026-02-18T00:06:58.949 INFO:teuthology.orchestra.run.trial061.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 747 kB/s | 67 kB 00:00 2026-02-18T00:06:59.075 INFO:teuthology.orchestra.run.trial061.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.4 MB/s | 838 kB 00:00 2026-02-18T00:06:59.088 INFO:teuthology.orchestra.run.trial061.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2026-02-18T00:06:59.097 INFO:teuthology.orchestra.run.trial061.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2026-02-18T00:06:59.213 INFO:teuthology.orchestra.run.trial061.stdout:(35/37): librados2-20.2.0-670.gadc19233.el9.x86 28 MB/s | 3.5 MB 00:00 2026-02-18T00:06:59.220 INFO:teuthology.orchestra.run.trial061.stdout:(36/37): librbd1-20.2.0-670.gadc19233.el9.x86_6 23 MB/s | 2.8 MB 00:00 2026-02-18T00:06:59.222 INFO:teuthology.orchestra.run.trial061.stdout:(37/37): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-18T00:06:59.225 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:06:59.226 INFO:teuthology.orchestra.run.trial061.stdout:Total 30 MB/s | 79 MB 00:02 2026-02-18T00:06:59.327 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:06:59.346 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:06:59.346 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:06:59.643 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:06:59.643 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:06:59.983 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:06:59.994 INFO:teuthology.orchestra.run.trial061.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-18T00:07:00.147 INFO:teuthology.orchestra.run.trial061.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-18T00:07:00.152 INFO:teuthology.orchestra.run.trial061.stdout: Upgrading : librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T00:07:00.201 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librados2-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T00:07:00.202 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T00:07:00.215 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T00:07:00.218 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T00:07:00.219 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T00:07:00.245 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T00:07:00.247 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T00:07:00.255 INFO:teuthology.orchestra.run.trial061.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-18T00:07:00.257 INFO:teuthology.orchestra.run.trial061.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-18T00:07:00.260 INFO:teuthology.orchestra.run.trial061.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-18T00:07:00.264 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-18T00:07:00.273 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 12/39 2026-02-18T00:07:00.285 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T00:07:00.286 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T00:07:00.300 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T00:07:00.334 INFO:teuthology.orchestra.run.trial061.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-18T00:07:00.338 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-18T00:07:00.344 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-18T00:07:00.347 INFO:teuthology.orchestra.run.trial061.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-18T00:07:00.351 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-18T00:07:00.474 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T00:07:00.475 INFO:teuthology.orchestra.run.trial061.stdout: Upgrading : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T00:07:00.500 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 21/39 2026-02-18T00:07:00.502 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 22/39 2026-02-18T00:07:00.508 INFO:teuthology.orchestra.run.trial061.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-18T00:07:00.786 INFO:teuthology.orchestra.run.trial061.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-18T00:07:00.787 INFO:teuthology.orchestra.run.trial061.stdout: Installing : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T00:07:00.803 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 25/39 2026-02-18T00:07:00.806 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 26/39 2026-02-18T00:07:00.811 INFO:teuthology.orchestra.run.trial061.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-18T00:07:00.813 INFO:teuthology.orchestra.run.trial061.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-18T00:07:00.814 INFO:teuthology.orchestra.run.trial061.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T00:07:00.844 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-18T00:07:00.958 INFO:teuthology.orchestra.run.trial061.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-18T00:07:00.960 INFO:teuthology.orchestra.run.trial061.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T00:07:01.240 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-18T00:07:01.240 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-18T00:07:01.240 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:01.281 INFO:teuthology.orchestra.run.trial061.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-18T00:07:01.283 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 33/39 2026-02-18T00:07:02.367 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T00:07:02.370 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T00:07:02.664 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 34/39 2026-02-18T00:07:02.667 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T00:07:02.706 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 35/39 2026-02-18T00:07:02.706 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T00:07:02.706 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T00:07:02.706 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:02.709 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T00:07:07.268 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /sys 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /proc 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /mnt 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /var/tmp 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /home 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /root 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout:skipping the directory /tmp 2026-02-18T00:07:07.269 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:08.297 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 37/39 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T00:07:08.321 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:08.323 INFO:teuthology.orchestra.run.trial061.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T00:07:08.336 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-18T00:07:08.337 INFO:teuthology.orchestra.run.trial061.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T00:07:08.392 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T00:07:08.392 INFO:teuthology.orchestra.run.trial061.stdout:Creating group 'qat' with GID 992. 2026-02-18T00:07:08.392 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 1/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 3/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 4/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 5/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 6/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 7/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 8/39 2026-02-18T00:07:08.723 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librgw2-2:20.2.0-670.gadc19233.el9.x86_64 9/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x 10/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86 11/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 12/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 13/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 14/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 15/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-18T00:07:08.724 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-18T00:07:08.725 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-18T00:07:08.726 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-18T00:07:08.726 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-18T00:07:08.726 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librados2-2:20.2.0-670.gadc19233.el9.x86_64 36/39 2026-02-18T00:07:08.726 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-18T00:07:08.726 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librbd1-2:20.2.0-670.gadc19233.el9.x86_64 38/39 2026-02-18T00:07:08.778 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-18T00:07:08.778 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:08.778 INFO:teuthology.orchestra.run.trial061.stdout:Upgraded: 2026-02-18T00:07:08.778 INFO:teuthology.orchestra.run.trial061.stdout: librados2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: librbd1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: ceph-radosgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: ceph-selinux-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-18T00:07:08.779 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-daemon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-proxy2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libradosstriper1-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: librgw2-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T00:07:08.780 INFO:teuthology.orchestra.run.trial061.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-argparse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-common-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-18T00:07:08.781 INFO:teuthology.orchestra.run.trial061.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T00:07:08.782 INFO:teuthology.orchestra.run.trial061.stdout: re2-1:20211101-20.el9.x86_64 2026-02-18T00:07:08.782 INFO:teuthology.orchestra.run.trial061.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T00:07:08.782 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:08.782 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:08.820 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-test 2026-02-18T00:07:09.128 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:14 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:09.209 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:09.209 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repository Size 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: ceph-test x86_64 2:20.2.0-670.gadc19233.el9 ceph 84 M 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout:Installing dependencies: 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: libcephsqlite x86_64 2:20.2.0-670.gadc19233.el9 ceph 164 k 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T00:07:09.210 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:Install 5 Packages 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 85 M 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 364 M 2026-02-18T00:07:09.211 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:09.355 INFO:teuthology.orchestra.run.trial061.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.3 MB/s | 233 kB 00:00 2026-02-18T00:07:09.384 INFO:teuthology.orchestra.run.trial061.stdout:(2/5): libcephsqlite-20.2.0-670.gadc19233.el9.x 2.0 MB/s | 164 kB 00:00 2026-02-18T00:07:09.409 INFO:teuthology.orchestra.run.trial061.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.5 MB/s | 303 kB 00:00 2026-02-18T00:07:09.410 INFO:teuthology.orchestra.run.trial061.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-18T00:07:10.953 INFO:teuthology.orchestra.run.trial061.stdout:(5/5): ceph-test-20.2.0-670.gadc19233.el9.x86_6 51 MB/s | 84 MB 00:01 2026-02-18T00:07:10.955 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:10.955 INFO:teuthology.orchestra.run.trial061.stdout:Total 48 MB/s | 85 MB 00:01 2026-02-18T00:07:10.981 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:10.991 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:10.991 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:11.278 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:11.278 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:11.589 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:11.595 INFO:teuthology.orchestra.run.trial061.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T00:07:11.600 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T00:07:11.608 INFO:teuthology.orchestra.run.trial061.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T00:07:11.609 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T00:07:15.414 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 4/5 2026-02-18T00:07:15.433 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T00:07:15.761 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 5/5 2026-02-18T00:07:15.761 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 1/5 2026-02-18T00:07:15.761 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2/5 2026-02-18T00:07:15.761 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T00:07:15.761 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T00:07:15.813 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T00:07:15.813 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: ceph-test-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: libcephsqlite-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:15.814 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:15.851 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph 2026-02-18T00:07:16.161 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:21 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:16.246 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout:====================================================================================== 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repository Size 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout:====================================================================================== 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph x86_64 2:20.2.0-670.gadc19233.el9 ceph 6.5 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout:Installing dependencies: 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-grafana-dashboards noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 43 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mds x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.3 M 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr x86_64 2:20.2.0-670.gadc19233.el9 ceph 961 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-modules-core noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 290 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mon x86_64 2:20.2.0-670.gadc19233.el9 ceph 5.1 M 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-osd x86_64 2:20.2.0-670.gadc19233.el9 ceph 17 M 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: ceph-prometheus-alerts noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 17 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 1.0 M 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-18T00:07:16.249 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T00:07:16.250 INFO:teuthology.orchestra.run.trial061.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout:Installing weak dependencies: 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-cephadm noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 173 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-dashboard noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 11 M 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 7.4 M 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 22 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-rook noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 50 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: ceph-volume noarch 2:20.2.0-670.gadc19233.el9 ceph-noarch 297 k 2026-02-18T00:07:16.251 INFO:teuthology.orchestra.run.trial061.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:====================================================================================== 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:Install 95 Packages 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 101 M 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 561 M 2026-02-18T00:07:16.252 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:16.597 INFO:teuthology.orchestra.run.trial061.stdout:(1/95): ceph-20.2.0-670.gadc19233.el9.x86_64.rp 124 kB/s | 6.5 kB 00:00 2026-02-18T00:07:16.660 INFO:teuthology.orchestra.run.trial061.stdout:(2/95): ceph-mgr-20.2.0-670.gadc19233.el9.x86_6 8.1 MB/s | 961 kB 00:00 2026-02-18T00:07:16.724 INFO:teuthology.orchestra.run.trial061.stdout:(3/95): ceph-mds-20.2.0-670.gadc19233.el9.x86_6 13 MB/s | 2.3 MB 00:00 2026-02-18T00:07:16.759 INFO:teuthology.orchestra.run.trial061.stdout:(4/95): ceph-grafana-dashboards-20.2.0-670.gadc 1.2 MB/s | 43 kB 00:00 2026-02-18T00:07:16.799 INFO:teuthology.orchestra.run.trial061.stdout:(5/95): ceph-mgr-cephadm-20.2.0-670.gadc19233.e 4.3 MB/s | 173 kB 00:00 2026-02-18T00:07:16.886 INFO:teuthology.orchestra.run.trial061.stdout:(6/95): ceph-mon-20.2.0-670.gadc19233.el9.x86_6 17 MB/s | 5.1 MB 00:00 2026-02-18T00:07:17.324 INFO:teuthology.orchestra.run.trial061.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-67 17 MB/s | 7.4 MB 00:00 2026-02-18T00:07:17.338 INFO:teuthology.orchestra.run.trial061.stdout:(8/95): ceph-mgr-dashboard-20.2.0-670.gadc19233 20 MB/s | 11 MB 00:00 2026-02-18T00:07:17.342 INFO:teuthology.orchestra.run.trial061.stdout:(9/95): ceph-mgr-k8sevents-20.2.0-670.gadc19233 1.1 MB/s | 22 kB 00:00 2026-02-18T00:07:17.357 INFO:teuthology.orchestra.run.trial061.stdout:(10/95): ceph-mgr-modules-core-20.2.0-670.gadc1 15 MB/s | 290 kB 00:00 2026-02-18T00:07:17.367 INFO:teuthology.orchestra.run.trial061.stdout:(11/95): ceph-mgr-rook-20.2.0-670.gadc19233.el9 2.0 MB/s | 50 kB 00:00 2026-02-18T00:07:17.395 INFO:teuthology.orchestra.run.trial061.stdout:(12/95): ceph-osd-20.2.0-670.gadc19233.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-18T00:07:17.396 INFO:teuthology.orchestra.run.trial061.stdout:(13/95): ceph-prometheus-alerts-20.2.0-670.gadc 454 kB/s | 17 kB 00:00 2026-02-18T00:07:17.397 INFO:teuthology.orchestra.run.trial061.stdout:(14/95): ceph-volume-20.2.0-670.gadc19233.el9.n 9.8 MB/s | 297 kB 00:00 2026-02-18T00:07:17.415 INFO:teuthology.orchestra.run.trial061.stdout:(15/95): cephadm-20.2.0-670.gadc19233.el9.noarc 51 MB/s | 1.0 MB 00:00 2026-02-18T00:07:17.484 INFO:teuthology.orchestra.run.trial061.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 464 kB/s | 40 kB 00:00 2026-02-18T00:07:17.526 INFO:teuthology.orchestra.run.trial061.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 648 kB/s | 72 kB 00:00 2026-02-18T00:07:17.564 INFO:teuthology.orchestra.run.trial061.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-18T00:07:17.597 INFO:teuthology.orchestra.run.trial061.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 2.5 MB/s | 184 kB 00:00 2026-02-18T00:07:17.600 INFO:teuthology.orchestra.run.trial061.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.8 MB/s | 253 kB 00:00 2026-02-18T00:07:17.620 INFO:teuthology.orchestra.run.trial061.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 5.7 MB/s | 794 kB 00:00 2026-02-18T00:07:17.630 INFO:teuthology.orchestra.run.trial061.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 3.5 MB/s | 106 kB 00:00 2026-02-18T00:07:17.648 INFO:teuthology.orchestra.run.trial061.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 4.8 MB/s | 135 kB 00:00 2026-02-18T00:07:17.661 INFO:teuthology.orchestra.run.trial061.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 4.7 MB/s | 150 kB 00:00 2026-02-18T00:07:17.675 INFO:teuthology.orchestra.run.trial061.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 4.6 MB/s | 126 kB 00:00 2026-02-18T00:07:17.696 INFO:teuthology.orchestra.run.trial061.stdout:(26/95): python3-cryptography-36.0.1-5.el9.x86_ 13 MB/s | 1.2 MB 00:00 2026-02-18T00:07:17.697 INFO:teuthology.orchestra.run.trial061.stdout:(27/95): python3-urllib3-1.26.5-7.el9.noarch.rp 6.0 MB/s | 218 kB 00:00 2026-02-18T00:07:17.704 INFO:teuthology.orchestra.run.trial061.stdout:(28/95): unzip-6.0-59.el9.x86_64.rpm 6.1 MB/s | 182 kB 00:00 2026-02-18T00:07:17.724 INFO:teuthology.orchestra.run.trial061.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-18T00:07:17.744 INFO:teuthology.orchestra.run.trial061.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 634 kB/s | 30 kB 00:00 2026-02-18T00:07:17.755 INFO:teuthology.orchestra.run.trial061.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 479 kB/s | 15 kB 00:00 2026-02-18T00:07:17.770 INFO:teuthology.orchestra.run.trial061.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 9.0 MB/s | 246 kB 00:00 2026-02-18T00:07:17.777 INFO:teuthology.orchestra.run.trial061.stdout:(33/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 41 MB/s | 3.0 MB 00:00 2026-02-18T00:07:17.782 INFO:teuthology.orchestra.run.trial061.stdout:(34/95): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-18T00:07:17.796 INFO:teuthology.orchestra.run.trial061.stdout:(35/95): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-18T00:07:17.819 INFO:teuthology.orchestra.run.trial061.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 27 MB/s | 1.0 MB 00:00 2026-02-18T00:07:17.850 INFO:teuthology.orchestra.run.trial061.stdout:(37/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 73 MB/s | 5.3 MB 00:00 2026-02-18T00:07:17.851 INFO:teuthology.orchestra.run.trial061.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 7.7 MB/s | 244 kB 00:00 2026-02-18T00:07:17.858 INFO:teuthology.orchestra.run.trial061.stdout:(39/95): python3-babel-2.9.1-2.el9.noarch.rpm 97 MB/s | 6.0 MB 00:00 2026-02-18T00:07:17.876 INFO:teuthology.orchestra.run.trial061.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.3 MB/s | 249 kB 00:00 2026-02-18T00:07:17.881 INFO:teuthology.orchestra.run.trial061.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 1.6 MB/s | 48 kB 00:00 2026-02-18T00:07:17.888 INFO:teuthology.orchestra.run.trial061.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 5.8 MB/s | 177 kB 00:00 2026-02-18T00:07:17.904 INFO:teuthology.orchestra.run.trial061.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 43 MB/s | 1.2 MB 00:00 2026-02-18T00:07:17.913 INFO:teuthology.orchestra.run.trial061.stdout:(44/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2026-02-18T00:07:17.951 INFO:teuthology.orchestra.run.trial061.stdout:(45/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 99 MB/s | 6.1 MB 00:00 2026-02-18T00:07:17.955 INFO:teuthology.orchestra.run.trial061.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2026-02-18T00:07:17.976 INFO:teuthology.orchestra.run.trial061.stdout:(47/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 7.6 MB/s | 159 kB 00:00 2026-02-18T00:07:17.990 INFO:teuthology.orchestra.run.trial061.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 6.7 MB/s | 267 kB 00:00 2026-02-18T00:07:18.003 INFO:teuthology.orchestra.run.trial061.stdout:(49/95): python3-pyasn1-modules-0.4.8-6.el9.noa 10 MB/s | 279 kB 00:00 2026-02-18T00:07:18.017 INFO:teuthology.orchestra.run.trial061.stdout:(50/95): python3-requests-oauthlib-1.3.0-12.el9 1.9 MB/s | 54 kB 00:00 2026-02-18T00:07:18.043 INFO:teuthology.orchestra.run.trial061.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-18T00:07:18.062 INFO:teuthology.orchestra.run.trial061.stdout:(52/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-18T00:07:18.067 INFO:teuthology.orchestra.run.trial061.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.0 MB/s | 189 kB 00:00 2026-02-18T00:07:18.085 INFO:teuthology.orchestra.run.trial061.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-18T00:07:18.113 INFO:teuthology.orchestra.run.trial061.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 490 kB/s | 22 kB 00:00 2026-02-18T00:07:18.145 INFO:teuthology.orchestra.run.trial061.stdout:(56/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 136 MB/s | 19 MB 00:00 2026-02-18T00:07:18.232 INFO:teuthology.orchestra.run.trial061.stdout:(57/95): protobuf-compiler-3.14.0-17.el9.x86_64 5.7 MB/s | 862 kB 00:00 2026-02-18T00:07:18.541 INFO:teuthology.orchestra.run.trial061.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2026-02-18T00:07:18.789 INFO:teuthology.orchestra.run.trial061.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 272 kB/s | 151 kB 00:00 2026-02-18T00:07:18.871 INFO:teuthology.orchestra.run.trial061.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 364 kB/s | 29 kB 00:00 2026-02-18T00:07:18.951 INFO:teuthology.orchestra.run.trial061.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 749 kB/s | 60 kB 00:00 2026-02-18T00:07:19.036 INFO:teuthology.orchestra.run.trial061.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 510 kB/s | 43 kB 00:00 2026-02-18T00:07:19.116 INFO:teuthology.orchestra.run.trial061.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 404 kB/s | 32 kB 00:00 2026-02-18T00:07:19.196 INFO:teuthology.orchestra.run.trial061.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 178 kB/s | 14 kB 00:00 2026-02-18T00:07:19.229 INFO:teuthology.orchestra.run.trial061.stdout:(65/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 494 kB/s | 551 kB 00:01 2026-02-18T00:07:19.242 INFO:teuthology.orchestra.run.trial061.stdout:(66/95): python3-asyncssh-2.13.2-5.el9.noarch.r 783 kB/s | 548 kB 00:00 2026-02-18T00:07:19.433 INFO:teuthology.orchestra.run.trial061.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 732 kB/s | 173 kB 00:00 2026-02-18T00:07:19.554 INFO:teuthology.orchestra.run.trial061.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 815 kB/s | 254 kB 00:00 2026-02-18T00:07:19.703 INFO:teuthology.orchestra.run.trial061.stdout:(69/95): python3-cherrypy-18.6.1-2.el9.noarch.r 756 kB/s | 358 kB 00:00 2026-02-18T00:07:19.790 INFO:teuthology.orchestra.run.trial061.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 614 kB/s | 144 kB 00:00 2026-02-18T00:07:19.871 INFO:teuthology.orchestra.run.trial061.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 829 kB/s | 139 kB 00:00 2026-02-18T00:07:19.871 INFO:teuthology.orchestra.run.trial061.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 687 kB/s | 56 kB 00:00 2026-02-18T00:07:19.950 INFO:teuthology.orchestra.run.trial061.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 134 kB/s | 11 kB 00:00 2026-02-18T00:07:19.951 INFO:teuthology.orchestra.run.trial061.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 221 kB/s | 18 kB 00:00 2026-02-18T00:07:20.030 INFO:teuthology.orchestra.run.trial061.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 293 kB/s | 23 kB 00:00 2026-02-18T00:07:20.036 INFO:teuthology.orchestra.run.trial061.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 232 kB/s | 20 kB 00:00 2026-02-18T00:07:20.109 INFO:teuthology.orchestra.run.trial061.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 246 kB/s | 19 kB 00:00 2026-02-18T00:07:20.115 INFO:teuthology.orchestra.run.trial061.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 331 kB/s | 26 kB 00:00 2026-02-18T00:07:20.272 INFO:teuthology.orchestra.run.trial061.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 503 kB/s | 79 kB 00:00 2026-02-18T00:07:20.437 INFO:teuthology.orchestra.run.trial061.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 527 kB/s | 86 kB 00:00 2026-02-18T00:07:20.516 INFO:teuthology.orchestra.run.trial061.stdout:(81/95): python3-natsort-7.1.1-5.el9.noarch.rpm 730 kB/s | 58 kB 00:00 2026-02-18T00:07:20.599 INFO:teuthology.orchestra.run.trial061.stdout:(82/95): python3-portend-3.1.0-2.el9.noarch.rpm 197 kB/s | 16 kB 00:00 2026-02-18T00:07:20.765 INFO:teuthology.orchestra.run.trial061.stdout:(83/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 543 kB/s | 90 kB 00:00 2026-02-18T00:07:20.844 INFO:teuthology.orchestra.run.trial061.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 388 kB/s | 31 kB 00:00 2026-02-18T00:07:21.088 INFO:teuthology.orchestra.run.trial061.stdout:(85/95): python3-routes-2.5.1-5.el9.noarch.rpm 775 kB/s | 188 kB 00:00 2026-02-18T00:07:21.168 INFO:teuthology.orchestra.run.trial061.stdout:(86/95): python3-rsa-4.9-2.el9.noarch.rpm 740 kB/s | 59 kB 00:00 2026-02-18T00:07:21.281 INFO:teuthology.orchestra.run.trial061.stdout:(87/95): python3-kubernetes-26.1.0-3.el9.noarch 892 kB/s | 1.0 MB 00:01 2026-02-18T00:07:21.325 INFO:teuthology.orchestra.run.trial061.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 796 kB/s | 125 kB 00:00 2026-02-18T00:07:21.366 INFO:teuthology.orchestra.run.trial061.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 420 kB/s | 36 kB 00:00 2026-02-18T00:07:21.481 INFO:teuthology.orchestra.run.trial061.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 555 kB/s | 86 kB 00:00 2026-02-18T00:07:21.531 INFO:teuthology.orchestra.run.trial061.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 543 kB/s | 90 kB 00:00 2026-02-18T00:07:21.560 INFO:teuthology.orchestra.run.trial061.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 614 kB/s | 48 kB 00:00 2026-02-18T00:07:21.618 INFO:teuthology.orchestra.run.trial061.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 256 kB/s | 22 kB 00:00 2026-02-18T00:07:21.640 INFO:teuthology.orchestra.run.trial061.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 249 kB/s | 20 kB 00:00 2026-02-18T00:07:21.799 INFO:teuthology.orchestra.run.trial061.stdout:(95/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 882 kB/s | 2.0 MB 00:02 2026-02-18T00:07:21.805 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:21.805 INFO:teuthology.orchestra.run.trial061.stdout:Total 18 MB/s | 101 MB 00:05 2026-02-18T00:07:22.229 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:22.266 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:22.266 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:22.698 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:22.698 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:23.150 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:23.152 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-18T00:07:23.156 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-18T00:07:23.178 INFO:teuthology.orchestra.run.trial061.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-18T00:07:23.211 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-18T00:07:23.220 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-18T00:07:23.225 INFO:teuthology.orchestra.run.trial061.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-18T00:07:23.228 INFO:teuthology.orchestra.run.trial061.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-18T00:07:23.233 INFO:teuthology.orchestra.run.trial061.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-18T00:07:23.256 INFO:teuthology.orchestra.run.trial061.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-18T00:07:23.269 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-18T00:07:23.271 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-18T00:07:23.277 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-18T00:07:23.279 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-18T00:07:23.290 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-18T00:07:23.296 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-18T00:07:23.321 INFO:teuthology.orchestra.run.trial061.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-18T00:07:23.324 INFO:teuthology.orchestra.run.trial061.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-18T00:07:23.331 INFO:teuthology.orchestra.run.trial061.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-18T00:07:23.381 INFO:teuthology.orchestra.run.trial061.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-18T00:07:23.394 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-18T00:07:23.396 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-18T00:07:23.401 INFO:teuthology.orchestra.run.trial061.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-18T00:07:23.406 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-18T00:07:23.411 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-18T00:07:23.414 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-18T00:07:23.428 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-18T00:07:23.433 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-18T00:07:23.438 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-18T00:07:23.449 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-18T00:07:23.458 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-18T00:07:23.464 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-18T00:07:23.484 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-18T00:07:23.495 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-18T00:07:23.511 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-18T00:07:23.515 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-18T00:07:23.523 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-18T00:07:23.563 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-18T00:07:23.888 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-18T00:07:23.898 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-18T00:07:23.902 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-18T00:07:23.908 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-18T00:07:23.910 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-18T00:07:23.938 INFO:teuthology.orchestra.run.trial061.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-18T00:07:23.982 INFO:teuthology.orchestra.run.trial061.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-18T00:07:23.988 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-18T00:07:23.992 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-18T00:07:23.998 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-18T00:07:24.001 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-18T00:07:24.008 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-18T00:07:24.012 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-18T00:07:24.040 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-18T00:07:24.050 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-18T00:07:24.056 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-18T00:07:24.062 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-18T00:07:24.097 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-18T00:07:24.323 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-18T00:07:24.346 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-18T00:07:24.350 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-18T00:07:24.409 INFO:teuthology.orchestra.run.trial061.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-18T00:07:24.411 INFO:teuthology.orchestra.run.trial061.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-18T00:07:24.431 INFO:teuthology.orchestra.run.trial061.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-18T00:07:24.758 INFO:teuthology.orchestra.run.trial061.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-18T00:07:24.832 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-18T00:07:25.508 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-18T00:07:25.525 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-18T00:07:25.535 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-18T00:07:25.542 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-18T00:07:25.555 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-18T00:07:25.571 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-18T00:07:25.646 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-18T00:07:25.654 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-18T00:07:25.678 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-18T00:07:25.707 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-18T00:07:25.759 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-18T00:07:25.764 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-18T00:07:25.768 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-18T00:07:25.769 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-18T00:07:25.788 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T00:07:25.788 INFO:teuthology.orchestra.run.trial061.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-18T00:07:25.788 INFO:teuthology.orchestra.run.trial061.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-18T00:07:25.788 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:25.797 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T00:07:25.823 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-18T00:07:25.823 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T00:07:25.823 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:25.858 INFO:teuthology.orchestra.run.trial061.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-18T00:07:25.921 INFO:teuthology.orchestra.run.trial061.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-18T00:07:25.923 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T00:07:25.936 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 81/95 2026-02-18T00:07:25.936 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:25.936 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-18T00:07:25.937 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:26.609 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T00:07:26.634 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 82/95 2026-02-18T00:07:26.634 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:26.634 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T00:07:26.634 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T00:07:26.634 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T00:07:26.635 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:26.693 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T00:07:26.695 INFO:teuthology.orchestra.run.trial061.stdout: Installing : cephadm-2:20.2.0-670.gadc19233.el9.noarch 83/95 2026-02-18T00:07:26.702 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 84/95 2026-02-18T00:07:26.725 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 85/95 2026-02-18T00:07:26.726 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T00:07:27.874 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 86/95 2026-02-18T00:07:27.880 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T00:07:28.336 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 87/95 2026-02-18T00:07:28.337 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T00:07:28.349 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 88/95 2026-02-18T00:07:28.350 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T00:07:28.407 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 89/95 2026-02-18T00:07:28.450 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 90/95 2026-02-18T00:07:28.451 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 91/95 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T00:07:28.474 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:28.485 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T00:07:28.707 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 92/95 2026-02-18T00:07:28.708 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 93/95 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T00:07:28.731 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:28.829 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T00:07:28.850 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 94/95 2026-02-18T00:07:28.850 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:28.850 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T00:07:28.850 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T00:07:28.851 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T00:07:28.851 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:28.868 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T00:07:29.560 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-2:20.2.0-670.gadc19233.el9.x86_64 95/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-2:20.2.0-670.gadc19233.el9.x86_64 1/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 3/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 4/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 5/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9 6/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 7/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noar 8/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-670.gadc192 9/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noar 10/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.n 11/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 12/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9. 13/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 14/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : cephadm-2:20.2.0-670.gadc19233.el9.noarch 15/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-18T00:07:29.561 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-18T00:07:29.562 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-18T00:07:29.563 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-18T00:07:29.564 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-18T00:07:29.628 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-18T00:07:29.628 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:29.628 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-grafana-dashboards-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mds-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-k8sevents-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.629 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-modules-core-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mon-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: ceph-osd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: ceph-prometheus-alerts-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: ceph-volume-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: cephadm-2:20.2.0-670.gadc19233.el9.noarch 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-18T00:07:29.630 INFO:teuthology.orchestra.run.trial061.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: lua-5.4.4-4.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-18T00:07:29.631 INFO:teuthology.orchestra.run.trial061.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T00:07:29.632 INFO:teuthology.orchestra.run.trial061.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-18T00:07:29.633 INFO:teuthology.orchestra.run.trial061.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-18T00:07:29.634 INFO:teuthology.orchestra.run.trial061.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T00:07:29.635 INFO:teuthology.orchestra.run.trial061.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-18T00:07:29.636 INFO:teuthology.orchestra.run.trial061.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-18T00:07:29.637 INFO:teuthology.orchestra.run.trial061.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: unzip-6.0-59.el9.x86_64 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: zip-3.0-35.el9.x86_64 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:29.638 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:29.686 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-base 2026-02-18T00:07:29.999 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:34 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:30.063 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-base-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:30.081 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:30.081 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:30.081 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:30.103 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install cephadm 2026-02-18T00:07:30.412 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:30.475 INFO:teuthology.orchestra.run.trial061.stdout:Package cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:30.493 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:30.493 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:30.493 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:30.514 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T00:07:30.821 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:35 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repo Size 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-670.gadc19233.el9 ceph 154 k 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 154 k 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 447 k 2026-02-18T00:07:30.903 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:30.989 INFO:teuthology.orchestra.run.trial061.stdout:ceph-immutable-object-cache-20.2.0-670.gadc1923 1.8 MB/s | 154 kB 00:00 2026-02-18T00:07:30.989 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:30.989 INFO:teuthology.orchestra.run.trial061.stdout:Total 1.8 MB/s | 154 kB 00:00 2026-02-18T00:07:30.989 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:30.994 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:30.994 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:31.028 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:31.028 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:31.084 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:31.085 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T00:07:31.108 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T00:07:31.108 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:31.108 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T00:07:31.108 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-670.gadc19233.e 1/1 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout: ceph-immutable-object-cache-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:31.420 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:31.449 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-mgr 2026-02-18T00:07:31.760 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:36 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:31.824 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-mgr-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:31.842 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:31.843 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:31.843 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:31.864 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-mgr-dashboard 2026-02-18T00:07:32.170 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:32.234 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-mgr-dashboard-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:32.252 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:32.252 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:32.252 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:32.274 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-18T00:07:32.584 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:32.647 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:32.665 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:32.666 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:32.666 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:32.687 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-mgr-rook 2026-02-18T00:07:33.000 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:33.065 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-mgr-rook-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:33.083 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:33.083 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:33.083 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:33.105 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-mgr-cephadm 2026-02-18T00:07:33.418 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:33.482 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-mgr-cephadm-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:33.499 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:33.500 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:33.500 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:33.522 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-fuse 2026-02-18T00:07:33.831 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:33.914 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:33.914 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:33.914 INFO:teuthology.orchestra.run.trial061.stdout: Package Architecture Version Repository Size 2026-02-18T00:07:33.914 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout: ceph-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 942 k 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 942 k 2026-02-18T00:07:33.915 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 2.7 M 2026-02-18T00:07:33.916 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:34.032 INFO:teuthology.orchestra.run.trial061.stdout:ceph-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 7.9 MB/s | 942 kB 00:00 2026-02-18T00:07:34.032 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:34.032 INFO:teuthology.orchestra.run.trial061.stdout:Total 7.8 MB/s | 942 kB 00:00 2026-02-18T00:07:34.032 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:34.037 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:34.037 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:34.070 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:34.071 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:34.160 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:34.177 INFO:teuthology.orchestra.run.trial061.stdout: Installing : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:34.397 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout: ceph-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:34.454 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:34.483 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install ceph-volume 2026-02-18T00:07:34.791 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:34.855 INFO:teuthology.orchestra.run.trial061.stdout:Package ceph-volume-2:20.2.0-670.gadc19233.el9.noarch is already installed. 2026-02-18T00:07:34.873 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:34.874 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:34.874 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:34.896 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install librados-devel 2026-02-18T00:07:35.206 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:35.288 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:35.288 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repo Size 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout: librados-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 126 k 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:35.289 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:35.290 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 126 k 2026-02-18T00:07:35.290 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 449 k 2026-02-18T00:07:35.290 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:35.372 INFO:teuthology.orchestra.run.trial061.stdout:librados-devel-20.2.0-670.gadc19233.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-18T00:07:35.372 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:35.373 INFO:teuthology.orchestra.run.trial061.stdout:Total 1.5 MB/s | 126 kB 00:00 2026-02-18T00:07:35.373 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:35.375 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:35.376 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:35.406 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:35.407 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:35.461 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:35.478 INFO:teuthology.orchestra.run.trial061.stdout: Installing : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:35.558 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:35.618 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:35.618 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:35.618 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:35.618 INFO:teuthology.orchestra.run.trial061.stdout: librados-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:35.618 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:35.619 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:35.646 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install libcephfs2 2026-02-18T00:07:35.960 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:40 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:36.024 INFO:teuthology.orchestra.run.trial061.stdout:Package libcephfs2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:36.042 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:36.042 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:36.043 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:36.064 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install libcephfs-devel 2026-02-18T00:07:36.372 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:36.454 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:36.454 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repo Size 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-devel x86_64 2:20.2.0-670.gadc19233.el9 ceph 34 k 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:36.455 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 34 k 2026-02-18T00:07:36.456 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 155 k 2026-02-18T00:07:36.456 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:36.519 INFO:teuthology.orchestra.run.trial061.stdout:libcephfs-devel-20.2.0-670.gadc19233.el9.x86_64 538 kB/s | 34 kB 00:00 2026-02-18T00:07:36.519 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:36.520 INFO:teuthology.orchestra.run.trial061.stdout:Total 531 kB/s | 34 kB 00:00 2026-02-18T00:07:36.520 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:36.522 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:36.522 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:36.524 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:36.524 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:36.545 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:36.562 INFO:teuthology.orchestra.run.trial061.stdout: Installing : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:36.617 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:36.674 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:36.674 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:36.674 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:36.675 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-devel-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:36.675 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:36.675 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:36.701 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install librados2 2026-02-18T00:07:37.007 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:37.071 INFO:teuthology.orchestra.run.trial061.stdout:Package librados2-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:37.089 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:37.090 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:37.090 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:37.112 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install librbd1 2026-02-18T00:07:37.424 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:37.486 INFO:teuthology.orchestra.run.trial061.stdout:Package librbd1-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:37.503 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:37.504 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:37.504 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:37.526 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install python3-rados 2026-02-18T00:07:37.834 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:37.898 INFO:teuthology.orchestra.run.trial061.stdout:Package python3-rados-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:37.916 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:37.917 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:37.917 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:37.939 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install python3-rgw 2026-02-18T00:07:38.248 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:38.312 INFO:teuthology.orchestra.run.trial061.stdout:Package python3-rgw-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:38.330 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:38.331 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:38.331 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:38.352 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install python3-cephfs 2026-02-18T00:07:38.662 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:43 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:38.725 INFO:teuthology.orchestra.run.trial061.stdout:Package python3-cephfs-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:38.743 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:38.744 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:38.744 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:38.766 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install python3-rbd 2026-02-18T00:07:39.075 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:39.139 INFO:teuthology.orchestra.run.trial061.stdout:Package python3-rbd-2:20.2.0-670.gadc19233.el9.x86_64 is already installed. 2026-02-18T00:07:39.157 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:39.157 INFO:teuthology.orchestra.run.trial061.stdout:Nothing to do. 2026-02-18T00:07:39.158 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:39.180 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install rbd-fuse 2026-02-18T00:07:39.491 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:44 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:39.574 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:39.574 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:39.574 INFO:teuthology.orchestra.run.trial061.stdout: Package Architecture Version Repository Size 2026-02-18T00:07:39.574 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:39.574 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout: rbd-fuse x86_64 2:20.2.0-670.gadc19233.el9 ceph 91 k 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 91 k 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 238 k 2026-02-18T00:07:39.575 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:39.876 INFO:teuthology.orchestra.run.trial061.stdout:rbd-fuse-20.2.0-670.gadc19233.el9.x86_64.rpm 301 kB/s | 91 kB 00:00 2026-02-18T00:07:39.876 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:39.876 INFO:teuthology.orchestra.run.trial061.stdout:Total 300 kB/s | 91 kB 00:00 2026-02-18T00:07:39.876 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:39.881 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:39.881 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:39.912 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:39.912 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:39.963 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:39.980 INFO:teuthology.orchestra.run.trial061.stdout: Installing : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:40.068 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:40.127 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:40.127 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:40.128 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:40.128 INFO:teuthology.orchestra.run.trial061.stdout: rbd-fuse-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:40.128 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:40.128 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:40.155 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install rbd-mirror 2026-02-18T00:07:40.464 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:45 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout: Package Arch Version Repo Size 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout: rbd-mirror x86_64 2:20.2.0-670.gadc19233.el9 ceph 2.9 M 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:40.547 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:40.548 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 2.9 M 2026-02-18T00:07:40.548 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 11 M 2026-02-18T00:07:40.548 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:40.693 INFO:teuthology.orchestra.run.trial061.stdout:rbd-mirror-20.2.0-670.gadc19233.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-18T00:07:40.694 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:40.694 INFO:teuthology.orchestra.run.trial061.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-18T00:07:40.694 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:40.699 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:40.699 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:40.738 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:40.739 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:40.920 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:40.922 INFO:teuthology.orchestra.run.trial061.stdout: Installing : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:40.945 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:40.946 INFO:teuthology.orchestra.run.trial061.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T00:07:40.946 INFO:teuthology.orchestra.run.trial061.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T00:07:40.946 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T00:07:40.946 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T00:07:40.946 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout: rbd-mirror-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:41.272 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:41.301 DEBUG:teuthology.orchestra.run.trial061:> sudo yum -y install rbd-nbd 2026-02-18T00:07:41.620 INFO:teuthology.orchestra.run.trial061.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Feb 2026 12:06:55 AM UTC. 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout:Dependencies resolved. 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout: Package Architecture Version Repository Size 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout:Installing: 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout: rbd-nbd x86_64 2:20.2.0-670.gadc19233.el9 ceph 180 k 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:41.702 INFO:teuthology.orchestra.run.trial061.stdout:Transaction Summary 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout:================================================================================ 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout:Install 1 Package 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout:Total download size: 180 k 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout:Installed size: 498 k 2026-02-18T00:07:41.703 INFO:teuthology.orchestra.run.trial061.stdout:Downloading Packages: 2026-02-18T00:07:41.787 INFO:teuthology.orchestra.run.trial061.stdout:rbd-nbd-20.2.0-670.gadc19233.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-18T00:07:41.788 INFO:teuthology.orchestra.run.trial061.stdout:-------------------------------------------------------------------------------- 2026-02-18T00:07:41.788 INFO:teuthology.orchestra.run.trial061.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-18T00:07:41.788 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction check 2026-02-18T00:07:41.792 INFO:teuthology.orchestra.run.trial061.stdout:Transaction check succeeded. 2026-02-18T00:07:41.792 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction test 2026-02-18T00:07:41.824 INFO:teuthology.orchestra.run.trial061.stdout:Transaction test succeeded. 2026-02-18T00:07:41.824 INFO:teuthology.orchestra.run.trial061.stdout:Running transaction 2026-02-18T00:07:41.883 INFO:teuthology.orchestra.run.trial061.stdout: Preparing : 1/1 2026-02-18T00:07:41.900 INFO:teuthology.orchestra.run.trial061.stdout: Installing : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:41.985 INFO:teuthology.orchestra.run.trial061.stdout: Running scriptlet: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:42.043 INFO:teuthology.orchestra.run.trial061.stdout: Verifying : rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 1/1 2026-02-18T00:07:42.043 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:42.043 INFO:teuthology.orchestra.run.trial061.stdout:Installed: 2026-02-18T00:07:42.044 INFO:teuthology.orchestra.run.trial061.stdout: rbd-nbd-2:20.2.0-670.gadc19233.el9.x86_64 2026-02-18T00:07:42.044 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-18T00:07:42.044 INFO:teuthology.orchestra.run.trial061.stdout:Complete! 2026-02-18T00:07:42.077 DEBUG:teuthology.parallel:result is None 2026-02-18T00:07:42.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:07:42.195 DEBUG:teuthology.orchestra.run.trial061:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T00:07:42.216 INFO:teuthology.orchestra.run.trial061.stdout:20.2.0-670.gadc19233.el9 2026-02-18T00:07:42.216 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-670.gadc19233.el9 2026-02-18T00:07:42.216 INFO:teuthology.task.install:The correct ceph version 20.2.0-670.gadc19233 is installed. 2026-02-18T00:07:42.218 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T00:07:42.219 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:07:42.219 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T00:07:42.282 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T00:07:42.282 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:07:42.283 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T00:07:42.347 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T00:07:42.411 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T00:07:42.412 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:07:42.412 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T00:07:42.475 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T00:07:42.539 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T00:07:42.540 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:07:42.540 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T00:07:42.604 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T00:07:42.667 INFO:teuthology.run_tasks:Running task workunit... 2026-02-18T00:07:42.696 INFO:tasks.workunit:Pulling workunits from ref adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:07:42.696 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-18T00:07:42.696 INFO:tasks.workunit:timeout=3h 2026-02-18T00:07:42.696 INFO:tasks.workunit:cleanup=True 2026-02-18T00:07:42.697 DEBUG:teuthology.orchestra.run.trial061:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-18T00:07:42.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:07:42.724 INFO:teuthology.orchestra.run.trial061.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-18T00:07:42.725 DEBUG:teuthology.orchestra.run.trial061:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T00:07:42.780 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-18T00:07:42.780 DEBUG:teuthology.orchestra.run.trial061:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-18T00:07:42.838 DEBUG:teuthology.orchestra.run.trial061:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout adc1923395f2bcd6ae89b5d331d278364d1848ed 2026-02-18T00:07:42.901 INFO:tasks.workunit.client.0.trial061.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-18T00:08:02.028 INFO:tasks.workunit.client.0.trial061.stderr:Note: switching to 'adc1923395f2bcd6ae89b5d331d278364d1848ed'. 2026-02-18T00:08:02.028 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.028 INFO:tasks.workunit.client.0.trial061.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-18T00:08:02.028 INFO:tasks.workunit.client.0.trial061.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-18T00:08:02.028 INFO:tasks.workunit.client.0.trial061.stderr:state without impacting any branches by switching back to a branch. 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: git switch -c 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr:Or undo this operation with: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: git switch - 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr: 2026-02-18T00:08:02.029 INFO:tasks.workunit.client.0.trial061.stderr:HEAD is now at adc1923395f Merge PR #67279 into tentacle 2026-02-18T00:08:02.036 DEBUG:teuthology.orchestra.run.trial061:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-18T00:08:02.093 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-18T00:08:02.093 DEBUG:teuthology.orchestra.run.trial061:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-18T00:08:02.150 INFO:tasks.workunit:Running workunits matching erasure-code on client.0... 2026-02-18T00:08:02.151 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code-plugins.sh... 2026-02-18T00:08:02.151 DEBUG:teuthology.orchestra.run.trial061:workunit test erasure-code/test-erasure-code-plugins.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh 2026-02-18T00:08:02.213 INFO:tasks.workunit.client.0.trial061.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2026-02-18T00:08:02.213 INFO:tasks.workunit.client.0.trial061.stderr:++ TIMEOUT=300 2026-02-18T00:08:02.213 INFO:tasks.workunit.client.0.trial061.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-18T00:08:02.213 INFO:tasks.workunit.client.0.trial061.stderr:++ MAX_TIMEOUT=15 2026-02-18T00:08:02.213 INFO:tasks.workunit.client.0.trial061.stderr:++ PG_NUM=4 2026-02-18T00:08:02.214 INFO:tasks.workunit.client.0.trial061.stderr:++ TMPDIR=/tmp 2026-02-18T00:08:02.214 INFO:tasks.workunit.client.0.trial061.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-18T00:08:02.214 INFO:tasks.workunit.client.0.trial061.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-18T00:08:02.214 INFO:tasks.workunit.client.0.trial061.stderr:+++ uname 2026-02-18T00:08:02.215 INFO:tasks.workunit.client.0.trial061.stderr:++ '[' Linux = FreeBSD ']' 2026-02-18T00:08:02.215 INFO:tasks.workunit.client.0.trial061.stderr:++ SED=sed 2026-02-18T00:08:02.215 INFO:tasks.workunit.client.0.trial061.stderr:++ AWK=awk 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:+++ stty -a 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:+++ head -1 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:++ termwidth= 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:++ DIFFCOLOPTS='-y ' 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:++ KERNCORE=kernel.core_pattern 2026-02-18T00:08:02.216 INFO:tasks.workunit.client.0.trial061.stderr:++ EXTRA_OPTS= 2026-02-18T00:08:02.217 INFO:tasks.workunit.client.0.trial061.stderr:++ test '' = TESTS 2026-02-18T00:08:02.217 INFO:tasks.workunit.client.0.trial061.stderr:++ uname -m 2026-02-18T00:08:02.221 INFO:tasks.workunit.client.0.trial061.stderr:+ arch=x86_64 2026-02-18T00:08:02.221 INFO:tasks.workunit.client.0.trial061.stderr:+ case $arch in 2026-02-18T00:08:02.221 INFO:tasks.workunit.client.0.trial061.stderr:+ legacy_jerasure_plugins=(jerasure_generic jerasure_sse3 jerasure_sse4) 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ legacy_shec_plugins=(shec_generic shec_sse3 shec_sse4) 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ plugins=(jerasure shec lrc isa) 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ main test-erasure-code-plugins 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ shift 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ shopt -s -o xtrace 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:08:02.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-code-plugins 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:26: run: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:27: run: shift 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: export CEPH_MON=127.0.0.1:17110 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: CEPH_MON=127.0.0.1:17110 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:30: run: export CEPH_ARGS 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: uuidgen 2026-02-18T00:08:02.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: CEPH_ARGS+='--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none ' 2026-02-18T00:08:02.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:32: run: CEPH_ARGS+='--mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:02.224 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: set 2026-02-18T00:08:02.224 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: local 'funcs=TEST_ec_profile_warning 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:TEST_preload_no_warning 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:TEST_preload_no_warning_default 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:TEST_preload_warning' 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-18T00:08:02.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_ec_profile_warning td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:92: TEST_ec_profile_warning: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:94: TEST_ec_profile_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:02.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:02.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:02.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:02.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:02.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:02.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:02.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:02.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:02.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:02.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:02.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:02.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:02.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:02.233 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:02.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:08:02.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:95: TEST_ec_profile_warning: run_mon td/test-erasure-code-plugins a 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:02.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.265 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:02.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:08:02.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:02.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:02.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:02.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:02.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:02.340 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:02.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:96: TEST_ec_profile_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:02.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:02.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:02.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:02.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:02.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:02.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:02.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:02.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: seq 0 2 2026-02-18T00:08:02.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-18T00:08:02.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 0 2026-02-18T00:08:02.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:02.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:02.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:02.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:02.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d3bf5912-ad3b-4604-8e68-a9090bcd6cbc 2026-02-18T00:08:02.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d3bf5912-ad3b-4604-8e68-a9090bcd6cbc' 2026-02-18T00:08:02.512 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 d3bf5912-ad3b-4604-8e68-a9090bcd6cbc 2026-02-18T00:08:02.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:02.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDiApVpioe3HhAA/TsbhCyWXotzf47dLN6XyA== 2026-02-18T00:08:02.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDiApVpioe3HhAA/TsbhCyWXotzf47dLN6XyA=="}' 2026-02-18T00:08:02.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d3bf5912-ad3b-4604-8e68-a9090bcd6cbc -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:02.619 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:02.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:02.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiApVpioe3HhAA/TsbhCyWXotzf47dLN6XyA== --osd-uuid d3bf5912-ad3b-4604-8e68-a9090bcd6cbc 2026-02-18T00:08:02.644 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:02.642+0000 7fa8b87ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:02.645 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:02.644+0000 7fa8b87ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:02.646 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:02.645+0000 7fa8b87ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:02.647 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:02.645+0000 7fa8b87ac900 -1 bdev(0x562f42104c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:02.647 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:02.645+0000 7fa8b87ac900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:03.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:03.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:03.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:03.092 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:03.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:03.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:03.194 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:03.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:03.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:03.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:03.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:03.209 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:03.207+0000 7fad962de900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:03.210 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:03.208+0000 7fad962de900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:03.211 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:03.209+0000 7fad962de900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:03.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:03.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:03.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:03.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:03.377 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:03.375+0000 7fad962de900 -1 Falling back to public interface 2026-02-18T00:08:03.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:03.728 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:03.725+0000 7fad962de900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:04.390 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:04.390 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:04.390 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:04.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:04.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:04.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:04.486 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2094163248,v1:127.0.0.1:6801/2094163248] [v2:127.0.0.1:6802/2094163248,v1:127.0.0.1:6803/2094163248] exists,up d3bf5912-ad3b-4604-8e68-a9090bcd6cbc 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 1 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:04.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/1 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/1' 2026-02-18T00:08:04.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/1/journal' 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:04.491 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:04.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:04.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:04.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/1 2026-02-18T00:08:04.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:04.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=62726ef4-6419-4e50-a704-de37ca317a6e 2026-02-18T00:08:04.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 62726ef4-6419-4e50-a704-de37ca317a6e' 2026-02-18T00:08:04.495 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 62726ef4-6419-4e50-a704-de37ca317a6e 2026-02-18T00:08:04.496 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:04.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDkApVp6AfIHRAAAziFO4wXRfKWzYQGHpZnbQ== 2026-02-18T00:08:04.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDkApVp6AfIHRAAAziFO4wXRfKWzYQGHpZnbQ=="}' 2026-02-18T00:08:04.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 62726ef4-6419-4e50-a704-de37ca317a6e -i td/test-erasure-code-plugins/1/new.json 2026-02-18T00:08:04.604 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:04.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/1/new.json 2026-02-18T00:08:04.611 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkApVp6AfIHRAAAziFO4wXRfKWzYQGHpZnbQ== --osd-uuid 62726ef4-6419-4e50-a704-de37ca317a6e 2026-02-18T00:08:04.628 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:04.625+0000 7fa65bf83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:04.629 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:04.627+0000 7fa65bf83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:04.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:04.628+0000 7fa65bf83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:04.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:04.628+0000 7fa65bf83900 -1 bdev(0x55e644542c00 td/test-erasure-code-plugins/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:04.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:04.628+0000 7fa65bf83900 -1 bluestore(td/test-erasure-code-plugins/1) _read_fsid unparsable uuid 2026-02-18T00:08:05.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/1/keyring 2026-02-18T00:08:05.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:05.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:08:05.017 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:08:05.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:05.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:08:05.325 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:08:05.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:05.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:05.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:05.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:05.340 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:05.338+0000 7fadeb681900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:05.341 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:05.339+0000 7fadeb681900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:05.342 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:05.340+0000 7fadeb681900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:05.482 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:05.480+0000 7fadeb681900 -1 Falling back to public interface 2026-02-18T00:08:05.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:05.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:05.549 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:05.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:05.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:08:05.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:05.807 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:05.804+0000 7fadeb681900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:08:06.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:06.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:06.767 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:06.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:06.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:06.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:08:06.988 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2905715541,v1:127.0.0.1:6811/2905715541] [v2:127.0.0.1:6812/2905715541,v1:127.0.0.1:6813/2905715541] exists,up 62726ef4-6419-4e50-a704-de37ca317a6e 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 2 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:06.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/2 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/2' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/2/journal' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:06.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:06.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/2 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3d8fea66-7ded-4e91-99ef-447e6c681c96 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 3d8fea66-7ded-4e91-99ef-447e6c681c96' 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 3d8fea66-7ded-4e91-99ef-447e6c681c96 2026-02-18T00:08:06.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:07.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnApVpziQPABAA2GSfxTvRtMvsWU93mo+HaQ== 2026-02-18T00:08:07.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnApVpziQPABAA2GSfxTvRtMvsWU93mo+HaQ=="}' 2026-02-18T00:08:07.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3d8fea66-7ded-4e91-99ef-447e6c681c96 -i td/test-erasure-code-plugins/2/new.json 2026-02-18T00:08:07.226 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:08:07.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/2/new.json 2026-02-18T00:08:07.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnApVpziQPABAA2GSfxTvRtMvsWU93mo+HaQ== --osd-uuid 3d8fea66-7ded-4e91-99ef-447e6c681c96 2026-02-18T00:08:07.250 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.247+0000 7f9e60d97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:07.251 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.249+0000 7f9e60d97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:07.252 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.250+0000 7f9e60d97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:07.253 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.250+0000 7f9e60d97900 -1 bdev(0x562f22d5ec00 td/test-erasure-code-plugins/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:07.253 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.250+0000 7f9e60d97900 -1 bluestore(td/test-erasure-code-plugins/2) _read_fsid unparsable uuid 2026-02-18T00:08:07.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/2/keyring 2026-02-18T00:08:07.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:07.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:08:07.589 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:08:07.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:07.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:08:07.915 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:08:07.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:07.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:07.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:07.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:07.931 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.928+0000 7f8c9a5d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:07.932 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.930+0000 7f8c9a5d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:07.933 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:07.931+0000 7f8c9a5d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:08.069 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:08.067+0000 7f8c9a5d8900 -1 Falling back to public interface 2026-02-18T00:08:08.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:08:08.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:08.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:08:08.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:08.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:08.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:08.140 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:08.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:08.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:08.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:08:08.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:08.379 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:08.376+0000 7f8c9a5d8900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:08:09.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:09.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:09.371 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:09.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:09.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:09.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:08:09.592 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/251768335,v1:127.0.0.1:6819/251768335] [v2:127.0.0.1:6820/251768335,v1:127.0.0.1:6821/251768335] exists,up 3d8fea66-7ded-4e91-99ef-447e6c681c96 2026-02-18T00:08:09.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:09.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:09.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:09.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:100: TEST_ec_profile_warning: create_rbd_pool 2026-02-18T00:08:09.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:08:09.808 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' does not exist 2026-02-18T00:08:09.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:08:09.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:08:10.089 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:08:10.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:08:11.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:08:11.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:101: TEST_ec_profile_warning: wait_for_clean 2026-02-18T00:08:11.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:08:11.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:08:11.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:08:11.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:08:11.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:08:11.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-18T00:08:11.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-18T00:08:11.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-18T00:08:11.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:08:11.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:08:11.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-18T00:08:11.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-18T00:08:11.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705667' 2026-02-18T00:08:11.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:08:11.818 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:08:11.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-18T00:08:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-18T00:08:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705667 2-55834574851' 2026-02-18T00:08:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:08:11.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-18T00:08:11.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:08:11.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:08:11.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-18T00:08:11.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:08:11.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-18T00:08:11.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-18T00:08:11.882 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836484 2026-02-18T00:08:11.882 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:08:12.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-18T00:08:12.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:08:13.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:08:13.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:08:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-18T00:08:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:08:13.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-18T00:08:13.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:08:13.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:08:13.332 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705667 2026-02-18T00:08:13.332 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:08:13.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705667 2026-02-18T00:08:13.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-18T00:08:13.334 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705667 2026-02-18T00:08:13.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:08:13.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705667 2026-02-18T00:08:13.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:08:13.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-18T00:08:13.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:08:13.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:08:13.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-18T00:08:13.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:08:13.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-18T00:08:13.562 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574851 2026-02-18T00:08:13.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-18T00:08:13.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:08:13.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-18T00:08:13.784 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:08:13.784 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:08:13.784 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:08:14.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:08:14.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:08:14.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:08:14.309 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:08:14.309 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:08:14.309 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:08:14.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:08:14.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:08:14.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:08:14.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-18T00:08:14.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_generic crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_generic 2026-02-18T00:08:14.911 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:14.911 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:14.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:14.951 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:14.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:14.956 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:14.783+0000 7f5590be5640 0 mon.a@0(leader).osd e20 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:14.957 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:14.899+0000 7f5590be5640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:14.957 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:14.899+0000 7f5590be5640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:14.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-18T00:08:14.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse3 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse3 2026-02-18T00:08:15.243 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:15.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:15.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:15.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:15.281 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:15.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:15.287 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.112+0000 7f5590be5640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.287 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.229+0000 7f5590be5640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.287 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.229+0000 7f5590be5640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-18T00:08:15.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse4 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse4 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:15.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:15.609 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:15.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:15.615 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.443+0000 7f5590be5640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.615 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.557+0000 7f5590be5640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.615 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.557+0000 7f5590be5640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-18T00:08:15.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-18T00:08:15.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_generic crush-failure-domain=osd plugin=shec_generic 2026-02-18T00:08:15.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:15.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:15.941 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:15.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:15.947 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.772+0000 7f5590be5640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-18T00:08:15.947 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.887+0000 7f5590be5640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-18T00:08:15.947 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:15.887+0000 7f5590be5640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-18T00:08:15.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-18T00:08:15.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse3 crush-failure-domain=osd plugin=shec_sse3 2026-02-18T00:08:16.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:16.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:16.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:16.231 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:16.231 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.232 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:16.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:16.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:16.270 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:16.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:16.276 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.104+0000 7f5590be5640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.276 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.219+0000 7f5590be5640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.276 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.219+0000 7f5590be5640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-18T00:08:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse4 crush-failure-domain=osd plugin=shec_sse4 2026-02-18T00:08:16.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-18T00:08:16.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:16.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-18T00:08:16.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:16.610 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:16.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:16.616 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.440+0000 7f5590be5640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.616 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.557+0000 7f5590be5640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.617 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:16.557+0000 7f5590be5640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-18T00:08:16.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:115: TEST_ec_profile_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:16.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:16.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:16.619 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:16.619 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:16.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:16.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:16.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:16.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:16.725 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:16.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:16.726 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:16.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:16.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:16.728 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:16.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:16.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:16.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:16.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:16.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:16.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:16.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:16.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:16.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:16.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning td/test-erasure-code-plugins 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:58: TEST_preload_no_warning: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:16.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:16.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:16.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:16.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:16.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:16.746 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:16.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:16.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:16.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:16.747 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:16.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:16.749 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:16.749 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.749 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:16.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:16.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:16.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:16.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:16.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure 2026-02-18T00:08:16.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:16.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:16.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:16.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:16.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:16.844 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:16.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:16.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:16.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:16.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:16.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:16.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:16.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:16.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:16.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:16.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:16.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:16.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:17.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:17.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:17.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:17.046 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:17.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:17.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:17.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:17.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6a19ee74-ebf3-4b91-bb5e-f36a53235710 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6a19ee74-ebf3-4b91-bb5e-f36a53235710' 2026-02-18T00:08:17.057 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 6a19ee74-ebf3-4b91-bb5e-f36a53235710 2026-02-18T00:08:17.058 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:17.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDxApVpXqXKAxAAeO1PIdzUVBu9Sg+sIvoomQ== 2026-02-18T00:08:17.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDxApVpXqXKAxAAeO1PIdzUVBu9Sg+sIvoomQ=="}' 2026-02-18T00:08:17.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6a19ee74-ebf3-4b91-bb5e-f36a53235710 -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:17.167 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:17.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:17.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure --mkfs --key AQDxApVpXqXKAxAAeO1PIdzUVBu9Sg+sIvoomQ== --osd-uuid 6a19ee74-ebf3-4b91-bb5e-f36a53235710 2026-02-18T00:08:17.192 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.190+0000 7f4aad6a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.193 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.191+0000 7f4aad6a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.194 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.192+0000 7f4aad6a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.195 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.192+0000 7f4aad6a8900 -1 bdev(0x563f24ca6c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:17.195 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.193+0000 7f4aad6a8900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:17.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:17.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:17.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:17.622 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:17.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:17.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:17.725 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:17.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure 2026-02-18T00:08:17.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:17.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:17.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:17.742 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.739+0000 7f799fb97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.743 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.740+0000 7f799fb97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.744 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.741+0000 7f799fb97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:17.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:17.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:17.822 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:17.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:17.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:17.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:17.926 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:17.923+0000 7f799fb97900 -1 Falling back to public interface 2026-02-18T00:08:18.367 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:18.364+0000 7f799fb97900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:18.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:18.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:18.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:18.923 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:18.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:18.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:19.019 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/56846587,v1:127.0.0.1:6801/56846587] [v2:127.0.0.1:6802/56846587,v1:127.0.0.1:6803/56846587] exists,up 6a19ee74-ebf3-4b91-bb5e-f36a53235710 2026-02-18T00:08:19.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:19.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:19.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:19.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:19.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:19.069 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:19.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:19.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:19.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:19.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:19.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:19.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:19.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:19.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:19.184 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:19.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:19.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:19.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:19.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:19.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:19.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:19.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:19.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:19.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:19.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:19.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:19.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:19.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:19.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:19.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:19.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:19.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:19.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:19.197 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:19.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:19.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:19.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:19.199 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:19.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:19.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:19.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:19.201 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:19.201 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.202 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:19.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:19.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:19.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:19.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:19.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:19.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:19.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.225 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:19.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec 2026-02-18T00:08:19.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:19.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:19.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:19.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:19.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:19.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:19.253 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:19.253 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:19.253 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:19.254 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:19.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:19.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:19.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:19.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:19.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:19.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:19.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:19.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:19.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:19.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:19.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:19.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:19.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:19.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:19.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:19.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:19.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-18T00:08:19.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:19.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:19.465 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:19.466 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.466 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:19.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:19.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:19.505 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:19.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:19.514 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:19.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:19.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec 2026-02-18T00:08:19.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:19.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:19.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=01b19362-e8a9-4b02-acbe-c67145e6014e 2026-02-18T00:08:19.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 01b19362-e8a9-4b02-acbe-c67145e6014e' 2026-02-18T00:08:19.517 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 01b19362-e8a9-4b02-acbe-c67145e6014e 2026-02-18T00:08:19.517 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:19.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDzApVph9AyHxAAIiKyiN86kU4dDEozqxQoEw== 2026-02-18T00:08:19.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDzApVph9AyHxAAIiKyiN86kU4dDEozqxQoEw=="}' 2026-02-18T00:08:19.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 01b19362-e8a9-4b02-acbe-c67145e6014e -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:19.628 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:19.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:19.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec --mkfs --key AQDzApVph9AyHxAAIiKyiN86kU4dDEozqxQoEw== --osd-uuid 01b19362-e8a9-4b02-acbe-c67145e6014e 2026-02-18T00:08:19.652 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:19.649+0000 7f9d1f051900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:19.654 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:19.651+0000 7f9d1f051900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:19.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:19.652+0000 7f9d1f051900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:19.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:19.652+0000 7f9d1f051900 -1 bdev(0x5563da786c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:19.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:19.653+0000 7f9d1f051900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:20.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:20.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:20.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:20.110 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:20.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:20.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:20.233 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:20.230+0000 7fae46a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:20.234 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:20.231+0000 7fae46a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:20.235 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:20.232+0000 7fae46a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:20.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:20.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:20.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:20.456 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:20.454+0000 7fae46a10900 -1 Falling back to public interface 2026-02-18T00:08:20.882 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:20.879+0000 7fae46a10900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:21.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:21.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:21.412 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:21.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:21.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:21.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:21.508 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1744915991,v1:127.0.0.1:6801/1744915991] [v2:127.0.0.1:6802/1744915991,v1:127.0.0.1:6803/1744915991] exists,up 01b19362-e8a9-4b02-acbe-c67145e6014e 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:21.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:21.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:21.556 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:21.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:21.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:21.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:21.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:21.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:21.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:21.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:21.671 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:21.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:21.672 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:21.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:21.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:21.674 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:21.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:21.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:21.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:21.675 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:21.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:21.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:21.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:21.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:21.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:21.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:21.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:21.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:21.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:21.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:21.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:21.685 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:21.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:21.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:21.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:21.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:21.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:21.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:21.687 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:21.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:21.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:21.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:21.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:21.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:21.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:21.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:21.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:21.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:21.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:21.693 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:21.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=lrc 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:21.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=lrc 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.714 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:21.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=lrc 2026-02-18T00:08:21.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:21.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:21.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:21.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:21.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:21.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.741 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:21.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:21.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:21.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:21.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:21.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:21.788 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:21.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.929 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:21.930 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:21.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:21.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:21.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:21.989 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:21.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=lrc 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:21.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:21.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=lrc 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=264c8278-00b1-4796-b518-600157afb7af 2026-02-18T00:08:21.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 264c8278-00b1-4796-b518-600157afb7af' 2026-02-18T00:08:21.999 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 264c8278-00b1-4796-b518-600157afb7af 2026-02-18T00:08:21.999 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:22.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD2ApVpQbJNABAAhQ4V2q7q9NdQw5Pe1wurlQ== 2026-02-18T00:08:22.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD2ApVpQbJNABAAhQ4V2q7q9NdQw5Pe1wurlQ=="}' 2026-02-18T00:08:22.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 264c8278-00b1-4796-b518-600157afb7af -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:22.107 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:22.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:22.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc --mkfs --key AQD2ApVpQbJNABAAhQ4V2q7q9NdQw5Pe1wurlQ== --osd-uuid 264c8278-00b1-4796-b518-600157afb7af 2026-02-18T00:08:22.130 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.128+0000 7f53ffe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.132 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.129+0000 7f53ffe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.133 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.130+0000 7f53ffe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.133 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.130+0000 7f53ffe10900 -1 bdev(0x55f49009ac00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:22.133 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.130+0000 7f53ffe10900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:22.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:22.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:22.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:22.507 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:22.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:22.608 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:22.609 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:22.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc 2026-02-18T00:08:22.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:22.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:22.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:22.624 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.621+0000 7fc896cf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.625 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.623+0000 7fc896cf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.626 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.624+0000 7fc896cf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:22.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:22.708 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:22.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:22.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:22.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:22.847 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:22.845+0000 7fc896cf1900 -1 Falling back to public interface 2026-02-18T00:08:23.144 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:23.142+0000 7fc896cf1900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:23.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:23.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:23.806 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:23.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:23.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:23.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:23.902 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1901726774,v1:127.0.0.1:6801/1901726774] [v2:127.0.0.1:6802/1901726774,v1:127.0.0.1:6803/1901726774] exists,up 264c8278-00b1-4796-b518-600157afb7af 2026-02-18T00:08:23.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:23.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:23.949 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:23.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:23.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:23.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:23.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:23.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:23.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:23.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:23.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:23.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:23.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:23.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:24.065 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:24.065 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:24.065 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:24.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:24.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:24.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:24.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:24.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:24.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:24.069 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:24.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:24.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:24.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:24.073 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:24.074 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.074 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:24.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:24.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:24.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:24.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:24.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:24.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:24.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:24.079 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:24.079 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:24.079 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:24.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:24.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:24.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:24.080 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:24.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:24.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:24.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:24.083 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:24.083 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.083 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:24.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:24.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:24.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:24.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:24.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=isa 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:24.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:24.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=isa 2026-02-18T00:08:24.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:24.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:24.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=isa 2026-02-18T00:08:24.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:24.134 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:24.135 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:24.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:24.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:24.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:24.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:24.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:24.180 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:24.326 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:24.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:24.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-18T00:08:24.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:24.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:24.384 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=isa 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:24.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:24.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:24.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=isa 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:24.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a0ee3936-19a3-4d3a-8be2-528aefb8820f 2026-02-18T00:08:24.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a0ee3936-19a3-4d3a-8be2-528aefb8820f' 2026-02-18T00:08:24.395 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 a0ee3936-19a3-4d3a-8be2-528aefb8820f 2026-02-18T00:08:24.395 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:24.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD4ApVpec7fFxAAQ8pla+s7jSC02HNDiXzaPA== 2026-02-18T00:08:24.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD4ApVpec7fFxAAQ8pla+s7jSC02HNDiXzaPA=="}' 2026-02-18T00:08:24.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a0ee3936-19a3-4d3a-8be2-528aefb8820f -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:24.505 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:24.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:24.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa --mkfs --key AQD4ApVpec7fFxAAQ8pla+s7jSC02HNDiXzaPA== --osd-uuid a0ee3936-19a3-4d3a-8be2-528aefb8820f 2026-02-18T00:08:24.530 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:24.528+0000 7f4a936fd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:24.531 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:24.530+0000 7f4a936fd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:24.532 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:24.531+0000 7f4a936fd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:24.533 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:24.531+0000 7f4a936fd900 -1 bdev(0x560e701c8c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:24.533 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:24.531+0000 7f4a936fd900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:24.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:24.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:24.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:24.971 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:24.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:25.073 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:25.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:25.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa 2026-02-18T00:08:25.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:25.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:25.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:25.089 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:25.088+0000 7f1c46d64900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:25.091 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:25.089+0000 7f1c46d64900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:25.092 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:25.090+0000 7f1c46d64900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:25.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:25.172 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:25.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:25.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:25.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:25.291 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:25.290+0000 7f1c46d64900 -1 Falling back to public interface 2026-02-18T00:08:25.625 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:25.623+0000 7f1c46d64900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:26.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:26.269 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:26.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:26.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:26.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:26.368 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1418367688,v1:127.0.0.1:6801/1418367688] [v2:127.0.0.1:6802/1418367688,v1:127.0.0.1:6803/1418367688] exists,up a0ee3936-19a3-4d3a-8be2-528aefb8820f 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.369 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:26.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-18T00:08:26.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:26.415 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:26.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:26.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:26.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:26.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:26.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:26.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:26.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:26.529 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:26.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:26.530 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:26.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:26.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:26.532 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:26.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:26.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:26.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:26.533 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:26.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:26.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:26.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:26.538 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:26.538 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.538 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:72: TEST_preload_no_warning: return 0 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning_default td/test-erasure-code-plugins 2026-02-18T00:08:26.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:76: TEST_preload_no_warning_default: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:78: TEST_preload_no_warning_default: setup td/test-erasure-code-plugins 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:26.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:26.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:26.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:26.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:26.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:26.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:26.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:26.544 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:26.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:26.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:26.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:26.546 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:26.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:26.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:26.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:26.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:26.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:26.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:26.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:26.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:26.551 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:26.551 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.551 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:26.552 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:26.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:26.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:26.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:26.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:79: TEST_preload_no_warning_default: run_mon td/test-erasure-code-plugins a 2026-02-18T00:08:26.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:26.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:26.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:26.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:26.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:26.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:26.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:08:26.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:26.602 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:26.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:26.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:26.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:26.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:26.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:26.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:26.650 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:26.650 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: get_asok_path mon.a 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-18T00:08:26.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:26.734 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:81: TEST_preload_no_warning_default: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:26.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:26.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:26.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:26.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:26.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:26.842 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:26.842 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.842 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:26.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:26.843 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:82: TEST_preload_no_warning_default: run_osd td/test-erasure-code-plugins 0 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:26.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:26.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:26.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d1e9ab7-4c70-4f86-97b6-842039b3ebf4 2026-02-18T00:08:26.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9d1e9ab7-4c70-4f86-97b6-842039b3ebf4' 2026-02-18T00:08:26.863 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 9d1e9ab7-4c70-4f86-97b6-842039b3ebf4 2026-02-18T00:08:26.863 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:26.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD6ApVpHGr5MxAASqNFd71KrjCxS/d5YROxxw== 2026-02-18T00:08:26.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD6ApVpHGr5MxAASqNFd71KrjCxS/d5YROxxw=="}' 2026-02-18T00:08:26.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d1e9ab7-4c70-4f86-97b6-842039b3ebf4 -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:26.975 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:26.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:26.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6ApVpHGr5MxAASqNFd71KrjCxS/d5YROxxw== --osd-uuid 9d1e9ab7-4c70-4f86-97b6-842039b3ebf4 2026-02-18T00:08:27.000 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:26.998+0000 7f4c7c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.002 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.000+0000 7f4c7c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.001+0000 7f4c7c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.001+0000 7f4c7c20f900 -1 bdev(0x560c3b6dac00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:27.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.002+0000 7f4c7c20f900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:27.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:27.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:27.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:27.472 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:27.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:27.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:27.576 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:27.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:27.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:27.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:27.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:27.593 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.591+0000 7f9a333b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.594 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.593+0000 7f9a333b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.595 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.594+0000 7f9a333b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:27.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:27.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:27.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:27.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:27.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:27.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:27.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:27.676 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:27.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:27.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:27.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:27.780 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:27.779+0000 7f9a333b0900 -1 Falling back to public interface 2026-02-18T00:08:28.209 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:28.207+0000 7f9a333b0900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:28.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:28.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:28.773 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:28.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:28.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:28.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:28.868 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1218754554,v1:127.0.0.1:6801/1218754554] [v2:127.0.0.1:6802/1218754554,v1:127.0.0.1:6803/1218754554] exists,up 9d1e9ab7-4c70-4f86-97b6-842039b3ebf4 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: get_asok_path osd.0 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:28.870 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:28.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-18T00:08:28.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:28.917 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:28.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:84: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:28.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:85: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:86: TEST_preload_no_warning_default: teardown td/test-erasure-code-plugins 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:28.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:28.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:28.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:29.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:29.032 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:29.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:29.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:29.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:29.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:29.035 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:29.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:29.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:29.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:29.036 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:29.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:29.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:29.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:29.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:29.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:88: TEST_preload_no_warning_default: return 0 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_warning td/test-erasure-code-plugins 2026-02-18T00:08:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:41: TEST_preload_warning: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:29.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:29.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:29.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:29.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:29.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:29.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:29.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:29.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:29.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:29.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:29.048 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:29.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:29.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:29.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:29.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:29.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:29.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:29.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:29.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:29.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:29.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:29.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:29.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:29.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:29.074 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:29.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:29.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:29.100 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:29.101 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:29.101 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:29.101 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:29.101 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:29.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:29.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:29.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:29.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:29.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:29.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:29.149 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:29.149 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:29.149 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:29.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:29.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:29.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:29.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:29.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:29.291 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:29.291 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.292 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:29.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:29.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:29.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:29.351 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:29.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:29.359 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:29.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:29.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:29.361 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:29.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=87b79b35-0b30-4064-8177-7835fed79131 2026-02-18T00:08:29.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 87b79b35-0b30-4064-8177-7835fed79131' 2026-02-18T00:08:29.362 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 87b79b35-0b30-4064-8177-7835fed79131 2026-02-18T00:08:29.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:29.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD9ApVploD2FRAAa5/k9xW8sZU9DB230pRQ4Q== 2026-02-18T00:08:29.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD9ApVploD2FRAAa5/k9xW8sZU9DB230pRQ4Q=="}' 2026-02-18T00:08:29.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 87b79b35-0b30-4064-8177-7835fed79131 -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:29.473 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:29.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:29.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic --mkfs --key AQD9ApVploD2FRAAa5/k9xW8sZU9DB230pRQ4Q== --osd-uuid 87b79b35-0b30-4064-8177-7835fed79131 2026-02-18T00:08:29.497 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:29.495+0000 7fe882ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:29.499 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:29.497+0000 7fe882ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:29.500 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:29.498+0000 7fe882ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:29.500 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:29.498+0000 7fe882ed9900 -1 bdev(0x55749ae46c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:29.500 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:29.498+0000 7fe882ed9900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:29.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:29.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:29.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:29.904 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:29.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:30.010 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:30.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:30.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic 2026-02-18T00:08:30.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:30.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:30.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:30.027 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:30.025+0000 7ff040a0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:30.028 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:30.027+0000 7ff040a0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:30.029 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:30.028+0000 7ff040a0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:30.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:30.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:30.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:30.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:30.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:30.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:30.113 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:30.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:30.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:30.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:30.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:30.233 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:30.232+0000 7ff040a0c900 -1 Falling back to public interface 2026-02-18T00:08:30.536 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:30.534+0000 7ff040a0c900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:31.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:31.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:31.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:31.210 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:31.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:31.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:31.310 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/142021288,v1:127.0.0.1:6801/142021288] [v2:127.0.0.1:6802/142021288,v1:127.0.0.1:6803/142021288] exists,up 87b79b35-0b30-4064-8177-7835fed79131 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:31.312 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.313 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:31.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:31.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:31.358 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:31.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:31.364 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:29.090+0000 7fe4fadcad80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:31.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:31.365 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:30.232+0000 7ff040a0c900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:31.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:31.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:31.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:31.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:31.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:31.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:31.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:31.474 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:31.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:31.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:31.476 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:31.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:31.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:31.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:31.477 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:31.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:31.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:31.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:31.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:31.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:31.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:31.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:31.486 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:31.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:31.487 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:31.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:31.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:31.488 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:31.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:31.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:31.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:31.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:31.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:31.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:31.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:31.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:31.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:31.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:31.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:31.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:31.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:31.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:31.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:31.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:31.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:31.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:31.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:31.542 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:31.588 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:31.589 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:31.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:31.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:31.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:31.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.750 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:31.791 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:31.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:31.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:31.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:31.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=71d68728-001e-406c-aac4-e7c0834deb8b 2026-02-18T00:08:31.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 71d68728-001e-406c-aac4-e7c0834deb8b' 2026-02-18T00:08:31.798 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 71d68728-001e-406c-aac4-e7c0834deb8b 2026-02-18T00:08:31.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:31.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD/ApVpat8lMBAAZlglLMKFYuDQtB1RY83SWQ== 2026-02-18T00:08:31.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD/ApVpat8lMBAAZlglLMKFYuDQtB1RY83SWQ=="}' 2026-02-18T00:08:31.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 71d68728-001e-406c-aac4-e7c0834deb8b -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:31.911 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:31.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:31.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 --mkfs --key AQD/ApVpat8lMBAAZlglLMKFYuDQtB1RY83SWQ== --osd-uuid 71d68728-001e-406c-aac4-e7c0834deb8b 2026-02-18T00:08:31.937 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:31.935+0000 7fcb5580e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:31.938 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:31.936+0000 7fcb5580e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:31.939 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:31.937+0000 7fcb5580e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:31.940 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:31.938+0000 7fcb5580e900 -1 bdev(0x5645b9acac00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:31.940 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:31.938+0000 7fcb5580e900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:32.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:32.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:32.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:32.377 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:32.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:32.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:32.481 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:32.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 2026-02-18T00:08:32.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:32.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:32.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:32.497 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:32.495+0000 7f01001f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:32.498 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:32.496+0000 7f01001f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:32.499 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:32.497+0000 7f01001f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:32.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:32.578 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:32.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:32.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:32.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:32.720 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:32.718+0000 7f01001f4900 -1 Falling back to public interface 2026-02-18T00:08:33.055 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:33.053+0000 7f01001f4900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:33.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:33.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:34.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:34.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:34.779 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:08:34.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-18T00:08:34.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:34.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:35.004 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2530363647,v1:127.0.0.1:6801/2530363647] [v2:127.0.0.1:6802/2530363647,v1:127.0.0.1:6803/2530363647] exists,up 71d68728-001e-406c-aac4-e7c0834deb8b 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:35.006 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.007 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.007 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:35.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:35.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:35.051 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:35.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:35.057 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:31.532+0000 7fe527e0ed80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:35.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:35.059 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:32.719+0000 7f01001f4900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:35.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:35.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:35.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:35.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:35.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:35.165 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:35.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:35.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:35.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:35.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:35.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:35.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:35.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:35.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:35.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:35.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:35.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:35.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:35.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:35.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.175 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:35.177 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:35.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:35.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:35.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:35.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:35.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:35.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:35.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:35.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:35.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:35.180 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:35.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:35.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:35.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:35.182 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:35.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:35.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:35.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:35.184 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:35.184 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.184 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:35.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:35.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:35.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:35.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:35.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:35.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:35.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:35.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:35.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:35.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:35.237 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:35.237 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:35.238 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.238 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.238 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:35.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:35.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:35.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:35.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:35.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:35.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:35.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:35.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:35.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:35.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:35.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:35.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:35.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:35.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:35.427 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:35.427 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:35.427 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:35.427 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:35.428 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.428 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.428 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:35.428 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:35.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:35.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:35.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:35.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:35.486 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:35.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2e5c3aab-a90c-4bab-a517-5d81d30dcaed 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2e5c3aab-a90c-4bab-a517-5d81d30dcaed' 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 2e5c3aab-a90c-4bab-a517-5d81d30dcaed 2026-02-18T00:08:35.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADA5Vp6cP4HRAAQj8IWokRPo6Wu32teM2TCw== 2026-02-18T00:08:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADA5Vp6cP4HRAAQj8IWokRPo6Wu32teM2TCw=="}' 2026-02-18T00:08:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2e5c3aab-a90c-4bab-a517-5d81d30dcaed -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:35.606 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:35.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:35.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 --mkfs --key AQADA5Vp6cP4HRAAQj8IWokRPo6Wu32teM2TCw== --osd-uuid 2e5c3aab-a90c-4bab-a517-5d81d30dcaed 2026-02-18T00:08:35.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:35.628+0000 7f171781f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:35.632 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:35.629+0000 7f171781f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:35.632 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:35.630+0000 7f171781f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:35.633 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:35.631+0000 7f171781f900 -1 bdev(0x55f0cdb0cc00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:35.633 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:35.631+0000 7f171781f900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:36.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:36.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:36.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:36.052 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:36.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:36.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:36.155 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:36.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 2026-02-18T00:08:36.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:36.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:36.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:36.170 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:36.169+0000 7fc01c6d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:36.172 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:36.170+0000 7fc01c6d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:36.173 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:36.171+0000 7fc01c6d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:36.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:36.254 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:36.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:36.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:36.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:36.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:36.393 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:36.391+0000 7fc01c6d7900 -1 Falling back to public interface 2026-02-18T00:08:36.707 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:36.704+0000 7fc01c6d7900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:37.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:37.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:37.355 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:37.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:37.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:37.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:37.452 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3911711865,v1:127.0.0.1:6801/3911711865] [v2:127.0.0.1:6802/3911711865,v1:127.0.0.1:6803/3911711865] exists,up 2e5c3aab-a90c-4bab-a517-5d81d30dcaed 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:37.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:37.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:37.499 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:37.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:37.504 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:35.224+0000 7fdd37c12d80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:37.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:37.505 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:36.392+0000 7fc01c6d7900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:37.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:37.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:37.613 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:37.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:37.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:37.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:37.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:37.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:37.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:37.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:37.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:37.618 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:37.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:37.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:37.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:37.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:37.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:37.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:37.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:37.626 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:37.626 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:37.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:37.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:37.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:37.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:37.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:37.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:37.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:37.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:37.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:37.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:37.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:37.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:37.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:37.629 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:37.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:37.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:37.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:37.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:37.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:37.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:37.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:37.634 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:37.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:37.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:37.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:37.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:37.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:37.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:37.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:37.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:37.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:37.683 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:37.683 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:37.683 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:37.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:37.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:37.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:37.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:37.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:37.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:37.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:37.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:37.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:37.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:37.875 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:37.875 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.875 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:37.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:37.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.893 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.894 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:37.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:37.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:37.934 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:37.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:37.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:37.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:37.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:37.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:37.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:37.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8e7148ac-7557-4011-86dd-581f99722685 2026-02-18T00:08:37.947 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 8e7148ac-7557-4011-86dd-581f99722685 2026-02-18T00:08:37.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8e7148ac-7557-4011-86dd-581f99722685' 2026-02-18T00:08:37.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:37.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFA5VpnDOvOBAAI6WCwCSv4Y2vY38HiX9RxQ== 2026-02-18T00:08:37.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFA5VpnDOvOBAAI6WCwCSv4Y2vY38HiX9RxQ=="}' 2026-02-18T00:08:37.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8e7148ac-7557-4011-86dd-581f99722685 -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:38.052 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:38.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:38.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic --mkfs --key AQAFA5VpnDOvOBAAI6WCwCSv4Y2vY38HiX9RxQ== --osd-uuid 8e7148ac-7557-4011-86dd-581f99722685 2026-02-18T00:08:38.077 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.075+0000 7faf4f1dc900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.078 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.076+0000 7faf4f1dc900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.079 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.077+0000 7faf4f1dc900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.080 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.078+0000 7faf4f1dc900 -1 bdev(0x55c0c86e0c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:38.080 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.078+0000 7faf4f1dc900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:38.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:38.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:38.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:38.474 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:38.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:38.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:38.577 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:38.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic 2026-02-18T00:08:38.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:38.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:38.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:38.593 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.591+0000 7f32dd577900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.594 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.592+0000 7f32dd577900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.595 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.593+0000 7f32dd577900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:38.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:38.675 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:38.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:38.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:38.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:38.818 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:38.816+0000 7f32dd577900 -1 Falling back to public interface 2026-02-18T00:08:39.131 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:39.129+0000 7f32dd577900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:39.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:39.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:39.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:39.773 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:39.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:39.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:39.869 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2304016996,v1:127.0.0.1:6801/2304016996] [v2:127.0.0.1:6802/2304016996,v1:127.0.0.1:6803/2304016996] exists,up 8e7148ac-7557-4011-86dd-581f99722685 2026-02-18T00:08:39.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:39.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:39.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:39.919 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:39.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:39.924 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:37.671+0000 7f24b1412d80 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:39.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:39.926 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:38.816+0000 7f32dd577900 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:39.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:39.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:39.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:39.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:40.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:40.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:40.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:40.034 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:40.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:40.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:40.036 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:40.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:40.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:40.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:40.038 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:40.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:40.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:40.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:40.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:40.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:40.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:40.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:40.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:40.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:40.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:40.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:40.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:40.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:40.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:40.048 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:40.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:40.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:40.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:40.049 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:40.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:40.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:40.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:40.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:40.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:40.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:40.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:40.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:40.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:40.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:40.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:40.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.076 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:40.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:40.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:40.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:40.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:40.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:40.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:40.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:40.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:40.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.150 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.151 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:40.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:40.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:40.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:40.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:40.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:40.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:40.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:40.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:40.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:40.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:40.294 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:40.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:40.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:40.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:40.353 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:40.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:40.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:40.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:40.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8d57cb5f-eb98-4024-b7cd-17c84793ba0d 2026-02-18T00:08:40.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8d57cb5f-eb98-4024-b7cd-17c84793ba0d' 2026-02-18T00:08:40.365 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 8d57cb5f-eb98-4024-b7cd-17c84793ba0d 2026-02-18T00:08:40.365 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:40.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAIA5VpKj8OFhAAWEyRdW7i7WeiUlC5Y3xCXQ== 2026-02-18T00:08:40.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAIA5VpKj8OFhAAWEyRdW7i7WeiUlC5Y3xCXQ=="}' 2026-02-18T00:08:40.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8d57cb5f-eb98-4024-b7cd-17c84793ba0d -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:40.473 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:40.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:40.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 --mkfs --key AQAIA5VpKj8OFhAAWEyRdW7i7WeiUlC5Y3xCXQ== --osd-uuid 8d57cb5f-eb98-4024-b7cd-17c84793ba0d 2026-02-18T00:08:40.498 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:40.496+0000 7f806a181900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:40.500 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:40.498+0000 7f806a181900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:40.501 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:40.499+0000 7f806a181900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:40.501 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:40.499+0000 7f806a181900 -1 bdev(0x560ae77c2c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:40.501 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:40.499+0000 7f806a181900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:40.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:40.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:40.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:40.884 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:40.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:40.987 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 2026-02-18T00:08:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:41.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:41.001+0000 7fc201262900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:41.004 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:41.002+0000 7fc201262900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:41.005 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:41.003+0000 7fc201262900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:41.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:41.087 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:41.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:41.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:41.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:41.213 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:41.211+0000 7fc201262900 -1 Falling back to public interface 2026-02-18T00:08:41.603 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:41.601+0000 7fc201262900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:42.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:42.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:42.186 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:42.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:42.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:42.282 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/982661256,v1:127.0.0.1:6801/982661256] [v2:127.0.0.1:6802/982661256,v1:127.0.0.1:6803/982661256] exists,up 8d57cb5f-eb98-4024-b7cd-17c84793ba0d 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.284 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.285 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:42.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:42.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:42.330 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:42.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:42.336 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:40.091+0000 7f97bcc0bd80 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:42.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:42.337 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:41.212+0000 7fc201262900 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:42.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:42.445 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:42.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:42.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:42.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:42.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:42.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:42.448 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:42.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:42.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:42.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:42.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:42.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:42.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:42.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:42.453 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:42.453 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.453 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:42.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:42.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:42.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:42.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:42.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:42.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:42.457 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:42.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:42.458 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:42.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:42.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:42.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:42.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:42.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:42.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:42.460 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:42.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:42.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:42.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:42.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:42.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:42.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:42.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:42.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-18T00:08:42.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:42.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.19359 2026-02-18T00:08:42.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:42.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:42.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-18T00:08:42.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.488 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:42.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:42.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:42.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:42.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:42.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:42.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:42.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:42.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get fsid 2026-02-18T00:08:42.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:42.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:42.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:42.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:42.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:42.561 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:42.562 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.19359/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-18T00:08:42.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.705 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:42.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:42.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-mon.a.asok 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:42.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-mon.a.asok log flush 2026-02-18T00:08:42.765 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:42.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:42.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:42.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:42.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:42.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-18T00:08:42.774 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:42.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:42.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=14fb2b80-39b6-4799-92de-ae01570c5078 2026-02-18T00:08:42.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 14fb2b80-39b6-4799-92de-ae01570c5078' 2026-02-18T00:08:42.777 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 14fb2b80-39b6-4799-92de-ae01570c5078 2026-02-18T00:08:42.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:42.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKA5Vphs6fLhAA+Y0Tj7tdZQlH7FCL7UJ61g== 2026-02-18T00:08:42.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKA5Vphs6fLhAA+Y0Tj7tdZQlH7FCL7UJ61g=="}' 2026-02-18T00:08:42.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 14fb2b80-39b6-4799-92de-ae01570c5078 -i td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:42.888 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:42.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-18T00:08:42.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 --mkfs --key AQAKA5Vphs6fLhAA+Y0Tj7tdZQlH7FCL7UJ61g== --osd-uuid 14fb2b80-39b6-4799-92de-ae01570c5078 2026-02-18T00:08:42.913 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:42.911+0000 7ff279c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:42.914 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:42.913+0000 7ff279c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:42.916 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:42.914+0000 7ff279c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:42.916 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:42.914+0000 7ff279c97900 -1 bdev(0x56202f1f4c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:42.916 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:42.914+0000 7ff279c97900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-18T00:08:43.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-18T00:08:43.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:43.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:43.368 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:43.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:43.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:43.473 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:43.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=fac4f58f-3906-4afe-8722-ba24878cf237 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.19359/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 2026-02-18T00:08:43.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:43.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:43.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:43.488 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:43.486+0000 7f265131c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:43.489 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:43.488+0000 7f265131c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:43.490 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:43.489+0000 7f265131c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:43.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:43.571 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:43.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:43.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:43.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:43.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:43.694 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:43.692+0000 7f265131c900 -1 Falling back to public interface 2026-02-18T00:08:44.040 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:44.037+0000 7f265131c900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:44.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:44.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:44.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:44.670 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:44.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:44.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:44.771 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1597760035,v1:127.0.0.1:6801/1597760035] [v2:127.0.0.1:6802/1597760035,v1:127.0.0.1:6803/1597760035] exists,up 14fb2b80-39b6-4799-92de-ae01570c5078 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:44.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.19359/ceph-osd.0.asok 2026-02-18T00:08:44.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-18T00:08:44.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.19359/ceph-osd.0.asok log flush 2026-02-18T00:08:44.817 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:44.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-18T00:08:44.823 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:42.502+0000 7f6c9e218d80 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:44.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-18T00:08:44.824 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:43.692+0000 7f265131c900 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:44.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:44.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:44.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:44.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:44.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:44.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:44.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:44.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:44.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:44.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:44.935 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:44.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:44.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:44.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:44.936 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:44.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:44.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:44.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:44.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:44.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:44.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:44.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:44.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:44.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:44.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:54: TEST_preload_warning: return 0 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-code-plugins 0 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:44.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:44.946 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:44.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:44.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:44.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:44.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:44.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:44.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:08:44.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-18T00:08:44.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:44.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:44.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.19359 2026-02-18T00:08:44.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.19359 2026-02-18T00:08:44.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:44.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:44.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:08:44.952 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:08:44.952 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:08:44.977 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code.sh... 2026-02-18T00:08:44.977 DEBUG:teuthology.orchestra.run.trial061:workunit test erasure-code/test-erasure-code.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh 2026-02-18T00:08:45.041 INFO:tasks.workunit.client.0.trial061.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:08:45.044 INFO:tasks.workunit.client.0.trial061.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:08:45.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-code 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:22: run: local dir=td/test-erasure-code 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:23: run: shift 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: export CEPH_MON=127.0.0.1:7101 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: CEPH_MON=127.0.0.1:7101 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:26: run: export CEPH_ARGS 2026-02-18T00:08:45.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: uuidgen 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: CEPH_ARGS+='--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none ' 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:30: run: setup td/test-erasure-code 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:08:45.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:08:45.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:08:45.048 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:08:45.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:08:45.048 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:08:45.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:08:45.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:08:45.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:08:45.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:45.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:08:45.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:08:45.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:08:45.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:08:45.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:08:45.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-18T00:08:45.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:08:45.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.45132 2026-02-18T00:08:45.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:08:45.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:08:45.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code 2026-02-18T00:08:45.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:08:45.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.45132 2026-02-18T00:08:45.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code 1' TERM HUP INT 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:31: run: run_mon td/test-erasure-code a 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:08:45.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:08:45.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:08:45.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code/a 2026-02-18T00:08:45.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code/a --run-dir=td/test-erasure-code 2026-02-18T00:08:45.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:08:45.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:45.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:45.079 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:45.079 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.079 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.079 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:45.079 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code/a '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code/log --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:08:45.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:45.106 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45132/ceph-mon.a.asok 2026-02-18T00:08:45.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:45.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.45132/ceph-mon.a.asok config get fsid 2026-02-18T00:08:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:08:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:08:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:08:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:08:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45132/ceph-mon.a.asok 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:08:45.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.45132/ceph-mon.a.asok config get mon_host 2026-02-18T00:08:45.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:32: run: run_mgr td/test-erasure-code x 2026-02-18T00:08:45.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code 2026-02-18T00:08:45.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:08:45.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:08:45.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:08:45.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code/x 2026-02-18T00:08:45.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:45.300 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:45.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code/x '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:08:45.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: get_asok_path mon.a 2026-02-18T00:08:45.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:08:45.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:08:45.318 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:08:45.318 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.319 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45132/ceph-mon.a.asok 2026-02-18T00:08:45.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: CEPH_ARGS= 2026-02-18T00:08:45.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: ceph --admin-daemon /tmp/ceph-asok.45132/ceph-mon.a.asok log flush 2026-02-18T00:08:45.358 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:08:45.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:35: run: grep 'load: jerasure.*lrc' td/test-erasure-code/mon.a.log 2026-02-18T00:08:45.364 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:45.095+0000 7fa099c0dd80 0 load: jerasure load: lrc 2026-02-18T00:08:45.364 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: seq 0 10 2026-02-18T00:08:45.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:45.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 0 2026-02-18T00:08:45.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:45.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:45.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/0 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/0' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/0/journal' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:45.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/0 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52de3ff8-f579-49c0-ae8e-b83aa5618073 2026-02-18T00:08:45.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 52de3ff8-f579-49c0-ae8e-b83aa5618073' 2026-02-18T00:08:45.372 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 52de3ff8-f579-49c0-ae8e-b83aa5618073 2026-02-18T00:08:45.372 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:45.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQANA5Vps/J7FhAAJswYZJ5hI5vvr3aXXrtIYg== 2026-02-18T00:08:45.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQANA5Vps/J7FhAAJswYZJ5hI5vvr3aXXrtIYg=="}' 2026-02-18T00:08:45.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52de3ff8-f579-49c0-ae8e-b83aa5618073 -i td/test-erasure-code/0/new.json 2026-02-18T00:08:45.484 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:45.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/0/new.json 2026-02-18T00:08:45.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQANA5Vps/J7FhAAJswYZJ5hI5vvr3aXXrtIYg== --osd-uuid 52de3ff8-f579-49c0-ae8e-b83aa5618073 2026-02-18T00:08:45.509 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:45.506+0000 7fec88a12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:45.510 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:45.507+0000 7fec88a12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:45.511 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:45.508+0000 7fec88a12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:45.512 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:45.509+0000 7fec88a12900 -1 bdev(0x55ca85754c00 td/test-erasure-code/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:45.512 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:45.509+0000 7fec88a12900 -1 bluestore(td/test-erasure-code/0) _read_fsid unparsable uuid 2026-02-18T00:08:45.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/0/keyring 2026-02-18T00:08:45.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:45.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:08:45.921 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:08:45.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:46.027 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:08:46.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:08:46.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:46.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:46.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:46.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:46.043 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:46.040+0000 7f8110665900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:46.045 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:46.042+0000 7f8110665900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:46.046 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:46.043+0000 7f8110665900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:46.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:08:46.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:46.128 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:46.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:46.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:46.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:46.255 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:46.252+0000 7f8110665900 -1 Falling back to public interface 2026-02-18T00:08:46.564 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:46.561+0000 7f8110665900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:08:47.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:47.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:47.231 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:47.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:47.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:47.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:08:47.328 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1776240970,v1:127.0.0.1:6801/1776240970] [v2:127.0.0.1:6802/1776240970,v1:127.0.0.1:6803/1776240970] exists,up 52de3ff8-f579-49c0-ae8e-b83aa5618073 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 1 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/1 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:47.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/1' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/1/journal' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/1 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c4a6968a-a7a6-4758-a01c-f30f2cbd0e71 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 c4a6968a-a7a6-4758-a01c-f30f2cbd0e71 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c4a6968a-a7a6-4758-a01c-f30f2cbd0e71' 2026-02-18T00:08:47.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:47.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAPA5Vp0vxDFBAAE4pPzsDGwB9CPd4uXbAU3w== 2026-02-18T00:08:47.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAPA5Vp0vxDFBAAE4pPzsDGwB9CPd4uXbAU3w=="}' 2026-02-18T00:08:47.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c4a6968a-a7a6-4758-a01c-f30f2cbd0e71 -i td/test-erasure-code/1/new.json 2026-02-18T00:08:47.444 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:47.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/1/new.json 2026-02-18T00:08:47.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPA5Vp0vxDFBAAE4pPzsDGwB9CPd4uXbAU3w== --osd-uuid c4a6968a-a7a6-4758-a01c-f30f2cbd0e71 2026-02-18T00:08:47.468 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:47.465+0000 7f22525c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:47.469 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:47.466+0000 7f22525c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:47.470 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:47.467+0000 7f22525c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:47.471 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:47.468+0000 7f22525c8900 -1 bdev(0x559b2ff54c00 td/test-erasure-code/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:47.471 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:47.468+0000 7f22525c8900 -1 bluestore(td/test-erasure-code/1) _read_fsid unparsable uuid 2026-02-18T00:08:47.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/1/keyring 2026-02-18T00:08:47.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:47.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:08:47.794 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:08:47.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:48.110 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:08:48.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:08:48.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:48.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:48.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:48.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:48.127 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:48.124+0000 7fbdc135d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:48.128 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:48.125+0000 7fbdc135d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:48.129 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:48.126+0000 7fbdc135d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:48.265 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:48.262+0000 7fbdc135d900 -1 Falling back to public interface 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:48.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:48.333 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:48.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:48.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:48.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:08:48.560 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:48.556+0000 7fbdc135d900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:08:48.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:49.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:49.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:49.564 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:49.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:49.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:49.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:08:49.785 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2358525001,v1:127.0.0.1:6811/2358525001] [v2:127.0.0.1:6812/2358525001,v1:127.0.0.1:6813/2358525001] exists,up c4a6968a-a7a6-4758-a01c-f30f2cbd0e71 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 2 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:49.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/2 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/2' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/2/journal' 2026-02-18T00:08:49.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:49.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:49.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:49.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/2 2026-02-18T00:08:49.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:49.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f6f2b45-4899-483b-bd78-1f283b02003a 2026-02-18T00:08:49.794 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 1f6f2b45-4899-483b-bd78-1f283b02003a 2026-02-18T00:08:49.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 1f6f2b45-4899-483b-bd78-1f283b02003a' 2026-02-18T00:08:49.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:49.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQARA5VpJDKPLxAAMWYUlHoKfM6p9SObxziDFA== 2026-02-18T00:08:49.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQARA5VpJDKPLxAAMWYUlHoKfM6p9SObxziDFA=="}' 2026-02-18T00:08:49.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f6f2b45-4899-483b-bd78-1f283b02003a -i td/test-erasure-code/2/new.json 2026-02-18T00:08:50.024 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:08:50.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/2/new.json 2026-02-18T00:08:50.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARA5VpJDKPLxAAMWYUlHoKfM6p9SObxziDFA== --osd-uuid 1f6f2b45-4899-483b-bd78-1f283b02003a 2026-02-18T00:08:50.050 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.047+0000 7f8b7e822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.051 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.048+0000 7f8b7e822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.052 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.049+0000 7f8b7e822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.053 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.050+0000 7f8b7e822900 -1 bdev(0x55e179240c00 td/test-erasure-code/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:50.053 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.050+0000 7f8b7e822900 -1 bluestore(td/test-erasure-code/2) _read_fsid unparsable uuid 2026-02-18T00:08:50.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/2/keyring 2026-02-18T00:08:50.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:50.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:08:50.369 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:08:50.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:50.681 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:08:50.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:08:50.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:50.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:50.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:50.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:50.698 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.695+0000 7fa58373b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.700 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.697+0000 7fa58373b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.701 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.698+0000 7fa58373b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:50.831 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:50.827+0000 7fa58373b900 -1 Falling back to public interface 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:50.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:50.906 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:50.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:50.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:08:51.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:51.138 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:51.135+0000 7fa58373b900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:08:52.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:52.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:52.131 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:52.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:52.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:52.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:08:52.354 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1740013787,v1:127.0.0.1:6819/1740013787] [v2:127.0.0.1:6820/1740013787,v1:127.0.0.1:6821/1740013787] exists,up 1f6f2b45-4899-483b-bd78-1f283b02003a 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 3 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/3 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:52.355 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:52.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/3 2026-02-18T00:08:52.357 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:52.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=de64c189-f964-4ada-8f82-71989a030939 2026-02-18T00:08:52.358 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 de64c189-f964-4ada-8f82-71989a030939 2026-02-18T00:08:52.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 de64c189-f964-4ada-8f82-71989a030939' 2026-02-18T00:08:52.358 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAUA5Vpm33nFRAAwCfV1q3vewJKL6/zw/mBaQ== 2026-02-18T00:08:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAUA5Vpm33nFRAAwCfV1q3vewJKL6/zw/mBaQ=="}' 2026-02-18T00:08:52.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new de64c189-f964-4ada-8f82-71989a030939 -i td/test-erasure-code/3/new.json 2026-02-18T00:08:52.595 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:08:52.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/3/new.json 2026-02-18T00:08:52.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAUA5Vpm33nFRAAwCfV1q3vewJKL6/zw/mBaQ== --osd-uuid de64c189-f964-4ada-8f82-71989a030939 2026-02-18T00:08:52.621 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:52.618+0000 7f3dae705900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:52.622 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:52.619+0000 7f3dae705900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:52.623 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:52.620+0000 7f3dae705900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:52.624 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:52.620+0000 7f3dae705900 -1 bdev(0x55950e044c00 td/test-erasure-code/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:52.624 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:52.621+0000 7f3dae705900 -1 bluestore(td/test-erasure-code/3) _read_fsid unparsable uuid 2026-02-18T00:08:52.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/3/keyring 2026-02-18T00:08:52.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:52.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:08:52.934 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:08:52.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:53.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:08:53.249 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:08:53.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:53.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:53.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:53.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:53.264 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:53.261+0000 7f8aa2b24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:53.265 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:53.262+0000 7f8aa2b24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:53.266 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:53.263+0000 7f8aa2b24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:53.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:53.391+0000 7f8aa2b24900 -1 Falling back to public interface 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:53.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:53.473 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:53.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:53.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:53.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:08:53.663 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:53.660+0000 7f8aa2b24900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:08:53.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:54.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:54.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:54.700 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:54.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:54.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:54.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:08:54.927 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2556660272,v1:127.0.0.1:6827/2556660272] [v2:127.0.0.1:6828/2556660272,v1:127.0.0.1:6829/2556660272] exists,up de64c189-f964-4ada-8f82-71989a030939 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 4 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/4 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/4' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/4/journal' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:54.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:54.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/4 2026-02-18T00:08:54.930 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:54.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3a348e1c-de25-40a5-988c-195c292305ab 2026-02-18T00:08:54.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 3a348e1c-de25-40a5-988c-195c292305ab' 2026-02-18T00:08:54.931 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 3a348e1c-de25-40a5-988c-195c292305ab 2026-02-18T00:08:54.931 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:54.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAWA5VpV+EVOBAA8/uY/baeDBeEo2xdbMDjXg== 2026-02-18T00:08:54.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAWA5VpV+EVOBAA8/uY/baeDBeEo2xdbMDjXg=="}' 2026-02-18T00:08:54.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3a348e1c-de25-40a5-988c-195c292305ab -i td/test-erasure-code/4/new.json 2026-02-18T00:08:55.172 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:08:55.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/4/new.json 2026-02-18T00:08:55.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAWA5VpV+EVOBAA8/uY/baeDBeEo2xdbMDjXg== --osd-uuid 3a348e1c-de25-40a5-988c-195c292305ab 2026-02-18T00:08:55.197 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.195+0000 7f57f1e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.199 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.196+0000 7f57f1e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.200 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.197+0000 7f57f1e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.200 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.197+0000 7f57f1e22900 -1 bdev(0x5609a6ab0c00 td/test-erasure-code/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:55.200 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.197+0000 7f57f1e22900 -1 bluestore(td/test-erasure-code/4) _read_fsid unparsable uuid 2026-02-18T00:08:55.520 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/4/keyring 2026-02-18T00:08:55.520 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:55.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:08:55.521 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:08:55.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:55.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:55.850 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.847+0000 7f7d19948900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.851 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.849+0000 7f7d19948900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.853 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.850+0000 7f7d19948900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:55.978 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:55.974+0000 7f7d19948900 -1 Falling back to public interface 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:56.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:56.058 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:56.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:56.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:56.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:08:56.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:56.311 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:56.308+0000 7f7d19948900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:08:57.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:57.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:57.282 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:57.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:57.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:57.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:08:57.508 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1785964244,v1:127.0.0.1:6835/1785964244] [v2:127.0.0.1:6836/1785964244,v1:127.0.0.1:6837/1785964244] exists,up 3a348e1c-de25-40a5-988c-195c292305ab 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 5 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/5 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:08:57.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/5 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=39eda364-29ac-486e-a205-95ec01b34ec6 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 39eda364-29ac-486e-a205-95ec01b34ec6 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 39eda364-29ac-486e-a205-95ec01b34ec6' 2026-02-18T00:08:57.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:08:57.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAZA5VpUXkRHxAAoIpppQkmy7+iqy1/Sf2FRw== 2026-02-18T00:08:57.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAZA5VpUXkRHxAAoIpppQkmy7+iqy1/Sf2FRw=="}' 2026-02-18T00:08:57.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 39eda364-29ac-486e-a205-95ec01b34ec6 -i td/test-erasure-code/5/new.json 2026-02-18T00:08:57.748 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:08:57.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/5/new.json 2026-02-18T00:08:57.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAZA5VpUXkRHxAAoIpppQkmy7+iqy1/Sf2FRw== --osd-uuid 39eda364-29ac-486e-a205-95ec01b34ec6 2026-02-18T00:08:57.774 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:57.771+0000 7fab45cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:57.775 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:57.772+0000 7fab45cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:57.776 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:57.773+0000 7fab45cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:57.776 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:57.773+0000 7fab45cd9900 -1 bdev(0x561e0032ec00 td/test-erasure-code/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:08:57.776 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:57.774+0000 7fab45cd9900 -1 bluestore(td/test-erasure-code/5) _read_fsid unparsable uuid 2026-02-18T00:08:58.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/5/keyring 2026-02-18T00:08:58.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:08:58.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:08:58.092 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:08:58.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:08:58.401 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:08:58.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:08:58.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:08:58.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:08:58.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:08:58.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:08:58.417 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:58.414+0000 7f90fa570900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:58.418 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:58.415+0000 7f90fa570900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:58.419 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:58.416+0000 7f90fa570900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:08:58.553 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:58.549+0000 7f90fa570900 -1 Falling back to public interface 2026-02-18T00:08:58.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:58.623 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:08:58.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:08:58.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:58.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:08:58.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:08:58.917 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:08:58.914+0000 7f90fa570900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:08:59.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:09:00.071 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/706487855,v1:127.0.0.1:6843/706487855] [v2:127.0.0.1:6844/706487855,v1:127.0.0.1:6845/706487855] exists,up 39eda364-29ac-486e-a205-95ec01b34ec6 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 6 2026-02-18T00:09:00.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/6 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:00.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:09:00.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/6 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5af0fa87-324c-41ce-ab25-4b156aae6ef8 2026-02-18T00:09:00.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 5af0fa87-324c-41ce-ab25-4b156aae6ef8' 2026-02-18T00:09:00.079 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 5af0fa87-324c-41ce-ab25-4b156aae6ef8 2026-02-18T00:09:00.079 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:09:00.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAcA5VponsRBRAA80x4REqf1Cte2V2G3XKB7g== 2026-02-18T00:09:00.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAcA5VponsRBRAA80x4REqf1Cte2V2G3XKB7g=="}' 2026-02-18T00:09:00.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5af0fa87-324c-41ce-ab25-4b156aae6ef8 -i td/test-erasure-code/6/new.json 2026-02-18T00:09:00.313 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:09:00.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/6/new.json 2026-02-18T00:09:00.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcA5VponsRBRAA80x4REqf1Cte2V2G3XKB7g== --osd-uuid 5af0fa87-324c-41ce-ab25-4b156aae6ef8 2026-02-18T00:09:00.340 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.337+0000 7f7df2e10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:00.342 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.339+0000 7f7df2e10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:00.343 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.339+0000 7f7df2e10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:00.343 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.340+0000 7f7df2e10900 -1 bdev(0x564975344c00 td/test-erasure-code/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:09:00.343 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.340+0000 7f7df2e10900 -1 bluestore(td/test-erasure-code/6) _read_fsid unparsable uuid 2026-02-18T00:09:00.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/6/keyring 2026-02-18T00:09:00.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:09:00.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:09:00.674 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:09:00.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:09:00.984 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:09:00.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:09:00.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:00.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:09:00.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:09:00.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:09:01.001 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:00.998+0000 7fef1bc1f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:01.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:01.000+0000 7fef1bc1f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:01.004 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:01.001+0000 7fef1bc1f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:01.133 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:01.129+0000 7fef1bc1f900 -1 Falling back to public interface 2026-02-18T00:09:01.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:09:01.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:01.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:09:01.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:01.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:01.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:01.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:01.212 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:09:01.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:01.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:09:01.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:01.530 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:01.527+0000 7fef1bc1f900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:09:02.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:02.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:02.437 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:09:02.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:02.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:02.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:09:02.661 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3627030233,v1:127.0.0.1:6851/3627030233] [v2:127.0.0.1:6852/3627030233,v1:127.0.0.1:6853/3627030233] exists,up 5af0fa87-324c-41ce-ab25-4b156aae6ef8 2026-02-18T00:09:02.664 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:02.664 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 7 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/7 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:02.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/7' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/7/journal' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:02.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:09:02.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/7 2026-02-18T00:09:02.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:09:02.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920 2026-02-18T00:09:02.668 INFO:tasks.workunit.client.0.trial061.stdout:add osd7 c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920 2026-02-18T00:09:02.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920' 2026-02-18T00:09:02.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:09:02.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAeA5Vpp7UnKBAALyR131EHf4XHeHWPXkaaHA== 2026-02-18T00:09:02.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAeA5Vpp7UnKBAALyR131EHf4XHeHWPXkaaHA=="}' 2026-02-18T00:09:02.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920 -i td/test-erasure-code/7/new.json 2026-02-18T00:09:02.900 INFO:tasks.workunit.client.0.trial061.stdout:7 2026-02-18T00:09:02.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/7/new.json 2026-02-18T00:09:02.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAeA5Vpp7UnKBAALyR131EHf4XHeHWPXkaaHA== --osd-uuid c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920 2026-02-18T00:09:02.925 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:02.922+0000 7fd585d52900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:02.927 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:02.924+0000 7fd585d52900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:02.927 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:02.925+0000 7fd585d52900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:02.928 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:02.925+0000 7fd585d52900 -1 bdev(0x556b6d720c00 td/test-erasure-code/7/block) open stat got: (1) Operation not permitted 2026-02-18T00:09:02.928 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:02.925+0000 7fd585d52900 -1 bluestore(td/test-erasure-code/7) _read_fsid unparsable uuid 2026-02-18T00:09:03.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/7/keyring 2026-02-18T00:09:03.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:09:03.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-18T00:09:03.263 INFO:tasks.workunit.client.0.trial061.stdout:adding osd7 key to auth repository 2026-02-18T00:09:03.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:09:03.572 INFO:tasks.workunit.client.0.trial061.stdout:start osd.7 2026-02-18T00:09:03.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-18T00:09:03.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:03.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:09:03.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:09:03.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:09:03.589 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:03.586+0000 7f266eed7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:03.591 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:03.588+0000 7f266eed7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:03.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:03.589+0000 7f266eed7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:03.751 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:03.748+0000 7f266eed7900 -1 Falling back to public interface 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:09:03.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:03.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:03.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-18T00:09:04.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:04.139 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:04.136+0000 7f266eed7900 -1 osd.7 0 log_to_monitors true 2026-02-18T00:09:05.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:05.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:05.018 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:09:05.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:05.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:05.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-18T00:09:05.240 INFO:tasks.workunit.client.0.trial061.stdout:osd.7 up in weight 1 up_from 33 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/1686831700,v1:127.0.0.1:6859/1686831700] [v2:127.0.0.1:6860/1686831700,v1:127.0.0.1:6861/1686831700] exists,up c56ba5c0-eda2-4c25-ba3b-ec8e1d53d920 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 8 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/8 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:05.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/8' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/8/journal' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:05.243 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:09:05.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/8 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6f9ad786-f34d-4aac-9885-215b9d8b9a60 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stdout:add osd8 6f9ad786-f34d-4aac-9885-215b9d8b9a60 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 6f9ad786-f34d-4aac-9885-215b9d8b9a60' 2026-02-18T00:09:05.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:09:05.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAhA5VpaB8qDxAA6CixqLZNvya9Qvo3OWkEcw== 2026-02-18T00:09:05.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAhA5VpaB8qDxAA6CixqLZNvya9Qvo3OWkEcw=="}' 2026-02-18T00:09:05.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6f9ad786-f34d-4aac-9885-215b9d8b9a60 -i td/test-erasure-code/8/new.json 2026-02-18T00:09:05.484 INFO:tasks.workunit.client.0.trial061.stdout:8 2026-02-18T00:09:05.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/8/new.json 2026-02-18T00:09:05.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAhA5VpaB8qDxAA6CixqLZNvya9Qvo3OWkEcw== --osd-uuid 6f9ad786-f34d-4aac-9885-215b9d8b9a60 2026-02-18T00:09:05.511 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:05.508+0000 7f6531683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:05.512 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:05.509+0000 7f6531683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:05.513 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:05.510+0000 7f6531683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:05.514 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:05.511+0000 7f6531683900 -1 bdev(0x562b055fcc00 td/test-erasure-code/8/block) open stat got: (1) Operation not permitted 2026-02-18T00:09:05.514 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:05.511+0000 7f6531683900 -1 bluestore(td/test-erasure-code/8) _read_fsid unparsable uuid 2026-02-18T00:09:05.850 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/8/keyring 2026-02-18T00:09:05.850 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:09:05.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-18T00:09:05.851 INFO:tasks.workunit.client.0.trial061.stdout:adding osd8 key to auth repository 2026-02-18T00:09:05.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:09:06.163 INFO:tasks.workunit.client.0.trial061.stdout:start osd.8 2026-02-18T00:09:06.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-18T00:09:06.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:06.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:09:06.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:09:06.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:09:06.180 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:06.177+0000 7ff4be81f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:06.181 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:06.178+0000 7ff4be81f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:06.182 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:06.179+0000 7ff4be81f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:06.392 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:06.388+0000 7ff4be81f900 -1 Falling back to public interface 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:06.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:06.398 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:09:06.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:06.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:06.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-18T00:09:06.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:06.736 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:06.734+0000 7ff4be81f900 -1 osd.8 0 log_to_monitors true 2026-02-18T00:09:07.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:07.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:07.621 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:09:07.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:07.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:07.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-18T00:09:07.847 INFO:tasks.workunit.client.0.trial061.stdout:osd.8 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/1790829635,v1:127.0.0.1:6867/1790829635] [v2:127.0.0.1:6868/1790829635,v1:127.0.0.1:6869/1790829635] exists,up 6f9ad786-f34d-4aac-9885-215b9d8b9a60 2026-02-18T00:09:07.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:07.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 9 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/9 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:07.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:07.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:09:07.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/9 2026-02-18T00:09:07.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:09:07.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 2026-02-18T00:09:07.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42' 2026-02-18T00:09:07.855 INFO:tasks.workunit.client.0.trial061.stdout:add osd9 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 2026-02-18T00:09:07.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:09:07.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjA5VpRudXMxAA0AHJVBiK4Z3/blJ5Q5VshA== 2026-02-18T00:09:07.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjA5VpRudXMxAA0AHJVBiK4Z3/blJ5Q5VshA=="}' 2026-02-18T00:09:07.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 -i td/test-erasure-code/9/new.json 2026-02-18T00:09:08.089 INFO:tasks.workunit.client.0.trial061.stdout:9 2026-02-18T00:09:08.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/9/new.json 2026-02-18T00:09:08.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjA5VpRudXMxAA0AHJVBiK4Z3/blJ5Q5VshA== --osd-uuid 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 2026-02-18T00:09:08.115 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.113+0000 7fe25160f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.116 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.114+0000 7fe25160f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.117 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.115+0000 7fe25160f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.117 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.115+0000 7fe25160f900 -1 bdev(0x55f7b89c4c00 td/test-erasure-code/9/block) open stat got: (1) Operation not permitted 2026-02-18T00:09:08.117 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.115+0000 7fe25160f900 -1 bluestore(td/test-erasure-code/9) _read_fsid unparsable uuid 2026-02-18T00:09:08.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/9/keyring 2026-02-18T00:09:08.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:09:08.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-18T00:09:08.450 INFO:tasks.workunit.client.0.trial061.stdout:adding osd9 key to auth repository 2026-02-18T00:09:08.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stdout:start osd.9 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:09:08.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:09:08.780 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.778+0000 7f00a9c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.781 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.779+0000 7f00a9c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.782 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.780+0000 7f00a9c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:08.914 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:08.912+0000 7f00a9c97900 -1 Falling back to public interface 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-18T00:09:09.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:09.268 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:09.266+0000 7f00a9c97900 -1 osd.9 0 log_to_monitors true 2026-02-18T00:09:10.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:10.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:10.207 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:09:10.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:10.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:10.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-18T00:09:10.426 INFO:tasks.workunit.client.0.trial061.stdout:osd.9 up in weight 1 up_from 41 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/2911952081,v1:127.0.0.1:6875/2911952081] [v2:127.0.0.1:6876/2911952081,v1:127.0.0.1:6877/2911952081] exists,up 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 2026-02-18T00:09:10.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:10.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:10.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:10.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-18T00:09:10.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 10 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=10 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/10 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/10' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/10/journal' 2026-02-18T00:09:10.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:09:10.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/10 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:09:10.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3e7f9556-fc98-454b-b0db-b26b094a5e12 2026-02-18T00:09:10.434 INFO:tasks.workunit.client.0.trial061.stdout:add osd10 3e7f9556-fc98-454b-b0db-b26b094a5e12 2026-02-18T00:09:10.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd10 3e7f9556-fc98-454b-b0db-b26b094a5e12' 2026-02-18T00:09:10.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:09:10.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAmA5VpJkYyGhAA5Rmx2tJemtS5/TJ1IEAyUA== 2026-02-18T00:09:10.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAmA5VpJkYyGhAA5Rmx2tJemtS5/TJ1IEAyUA=="}' 2026-02-18T00:09:10.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3e7f9556-fc98-454b-b0db-b26b094a5e12 -i td/test-erasure-code/10/new.json 2026-02-18T00:09:10.666 INFO:tasks.workunit.client.0.trial061.stdout:10 2026-02-18T00:09:10.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/10/new.json 2026-02-18T00:09:10.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 10 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAmA5VpJkYyGhAA5Rmx2tJemtS5/TJ1IEAyUA== --osd-uuid 3e7f9556-fc98-454b-b0db-b26b094a5e12 2026-02-18T00:09:10.693 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:10.691+0000 7f3952cb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:10.695 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:10.692+0000 7f3952cb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:10.696 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:10.693+0000 7f3952cb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:10.696 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:10.694+0000 7f3952cb2900 -1 bdev(0x559516a20c00 td/test-erasure-code/10/block) open stat got: (1) Operation not permitted 2026-02-18T00:09:10.696 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:10.694+0000 7f3952cb2900 -1 bluestore(td/test-erasure-code/10) _read_fsid unparsable uuid 2026-02-18T00:09:11.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/10/keyring 2026-02-18T00:09:11.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:09:11.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd10 key to auth repository 2026-02-18T00:09:11.022 INFO:tasks.workunit.client.0.trial061.stdout:adding osd10 key to auth repository 2026-02-18T00:09:11.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:09:11.342 INFO:tasks.workunit.client.0.trial061.stdout:start osd.10 2026-02-18T00:09:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.10 2026-02-18T00:09:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 10 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:09:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:09:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:09:11.359 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:11.356+0000 7f208aa67900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:11.360 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:11.358+0000 7f208aa67900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:11.361 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:11.359+0000 7f208aa67900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:11.497 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:11.495+0000 7f208aa67900 -1 Falling back to public interface 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 10 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=10 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:11.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:11.567 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:09:11.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:11.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2026-02-18T00:09:11.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:11.844 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:11.841+0000 7f208aa67900 -1 osd.10 0 log_to_monitors true 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:12.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2026-02-18T00:09:13.017 INFO:tasks.workunit.client.0.trial061.stdout:osd.10 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/1410289362,v1:127.0.0.1:6883/1410289362] [v2:127.0.0.1:6884/1410289362,v1:127.0.0.1:6885/1410289362] exists,up 3e7f9556-fc98-454b-b0db-b26b094a5e12 2026-02-18T00:09:13.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:13.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:13.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:13.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:39: run: create_rbd_pool 2026-02-18T00:09:13.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-18T00:09:13.233 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' does not exist 2026-02-18T00:09:13.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-18T00:09:13.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:09:13.512 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:09:13.520 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:09:14.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-18T00:09:14.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:40: run: wait_for_clean 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:14.803 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:14.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:14.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:14.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:14.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:14.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:14.886 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:15.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:15.111 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:15.111 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:15.111 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.112 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:15.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-18T00:09:15.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-18T00:09:15.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488' 2026-02-18T00:09:15.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:15.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-18T00:09:15.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-18T00:09:15.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673' 2026-02-18T00:09:15.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.243 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:15.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-18T00:09:15.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-18T00:09:15.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855' 2026-02-18T00:09:15.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.308 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:15.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444040 2026-02-18T00:09:15.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444040 2026-02-18T00:09:15.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040' 2026-02-18T00:09:15.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.374 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:15.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313222 2026-02-18T00:09:15.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313222 2026-02-18T00:09:15.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222' 2026-02-18T00:09:15.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.437 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:15.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182406 2026-02-18T00:09:15.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182406 2026-02-18T00:09:15.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406' 2026-02-18T00:09:15.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:15.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051589 2026-02-18T00:09:15.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051589 2026-02-18T00:09:15.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589' 2026-02-18T00:09:15.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:15.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920773 2026-02-18T00:09:15.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920773 2026-02-18T00:09:15.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773' 2026-02-18T00:09:15.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:15.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789956 2026-02-18T00:09:15.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789956 2026-02-18T00:09:15.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789956' 2026-02-18T00:09:15.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.694 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:15.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659140 2026-02-18T00:09:15.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659140 2026-02-18T00:09:15.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789956 9-176093659140' 2026-02-18T00:09:15.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:15.758 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789956 9-176093659140 10-193273528323' 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-18T00:09:15.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:15.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:15.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836488 2026-02-18T00:09:15.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:15.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836488 2026-02-18T00:09:15.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-18T00:09:15.827 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836488 2026-02-18T00:09:15.827 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:16.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-18T00:09:16.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:16.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-18T00:09:16.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:16.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:16.051 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705673 2026-02-18T00:09:16.051 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:16.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705673 2026-02-18T00:09:16.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-18T00:09:16.053 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705673 2026-02-18T00:09:16.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-18T00:09:16.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:16.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-18T00:09:16.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:16.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:16.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574855 2026-02-18T00:09:16.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:16.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-18T00:09:16.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-18T00:09:16.281 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574855 2026-02-18T00:09:16.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:16.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-18T00:09:16.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:16.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444040 2026-02-18T00:09:16.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:16.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-73014444040 2026-02-18T00:09:16.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:16.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444040 2026-02-18T00:09:16.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 73014444040' 2026-02-18T00:09:16.513 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 73014444040 2026-02-18T00:09:16.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:16.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444038 -lt 73014444040 2026-02-18T00:09:16.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:09:17.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:09:17.737 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:17.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444040 -lt 73014444040 2026-02-18T00:09:17.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:17.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313222 2026-02-18T00:09:17.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:17.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:17.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313222 2026-02-18T00:09:17.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:17.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313222 2026-02-18T00:09:17.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313222' 2026-02-18T00:09:17.963 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 90194313222 2026-02-18T00:09:17.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:18.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313222 -lt 90194313222 2026-02-18T00:09:18.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:18.190 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182406 2026-02-18T00:09:18.190 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:18.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:18.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182406 2026-02-18T00:09:18.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:18.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182406 2026-02-18T00:09:18.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182406' 2026-02-18T00:09:18.194 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 107374182406 2026-02-18T00:09:18.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:18.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182406 -lt 107374182406 2026-02-18T00:09:18.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:18.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051589 2026-02-18T00:09:18.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:18.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:18.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051589 2026-02-18T00:09:18.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:18.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051589 2026-02-18T00:09:18.420 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 124554051589 2026-02-18T00:09:18.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051589' 2026-02-18T00:09:18.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:18.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051589 -lt 124554051589 2026-02-18T00:09:18.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:18.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920773 2026-02-18T00:09:18.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:18.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:18.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920773 2026-02-18T00:09:18.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:18.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920773 2026-02-18T00:09:18.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920773' 2026-02-18T00:09:18.649 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 141733920773 2026-02-18T00:09:18.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:18.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920773 -lt 141733920773 2026-02-18T00:09:18.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:18.872 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789956 2026-02-18T00:09:18.872 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:18.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:18.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789956 2026-02-18T00:09:18.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:18.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789956 2026-02-18T00:09:18.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789956' 2026-02-18T00:09:18.875 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 158913789956 2026-02-18T00:09:18.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:19.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-18T00:09:19.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:19.100 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659140 2026-02-18T00:09:19.100 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:19.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:19.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659140 2026-02-18T00:09:19.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:19.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659140 2026-02-18T00:09:19.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659140' 2026-02-18T00:09:19.103 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.9 seq 176093659140 2026-02-18T00:09:19.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:19.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659140 -lt 176093659140 2026-02-18T00:09:19.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:19.329 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528323 2026-02-18T00:09:19.329 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:19.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:19.330 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528323 2026-02-18T00:09:19.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528323 2026-02-18T00:09:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528323' 2026-02-18T00:09:19.332 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.10 seq 193273528323 2026-02-18T00:09:19.333 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:19.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-18T00:09:19.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:19.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:19.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:19.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-18T00:09:19.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:09:19.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:09:19.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:09:19.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:09:19.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:09:19.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:09:19.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:09:20.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:09:20.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:09:20.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:20.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: get_asok_path osd.0 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:09:20.403 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:09:20.404 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:20.404 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:20.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.45132/ceph-osd.0.asok 2026-02-18T00:09:20.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: CEPH_ARGS= 2026-02-18T00:09:20.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: ceph --admin-daemon /tmp/ceph-asok.45132/ceph-osd.0.asok log flush 2026-02-18T00:09:20.450 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:09:20.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:43: run: grep 'load: jerasure.*lrc' td/test-erasure-code/osd.0.log 2026-02-18T00:09:20.456 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:08:46.255+0000 7f8110665900 0 load: jerasure load: lrc 2026-02-18T00:09:20.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:44: run: create_erasure_coded_pool ecpool 2026-02-18T00:09:20.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:56: create_erasure_coded_pool: local poolname=ecpool 2026-02-18T00:09:20.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:58: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd 2026-02-18T00:09:20.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:60: create_erasure_coded_pool: create_pool ecpool 12 12 erasure myprofile 2026-02-18T00:09:20.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 12 12 erasure myprofile 2026-02-18T00:09:21.115 INFO:tasks.workunit.client.0.trial061.stderr:pool 'ecpool' already exists 2026-02-18T00:09:21.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:09:22.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:62: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:09:22.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:22.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:22.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:22.126 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:22.127 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:22.127 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:22.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:22.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:22.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:22.207 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:22.432 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.433 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:22.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-18T00:09:22.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-18T00:09:22.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492' 2026-02-18T00:09:22.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.496 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:22.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-18T00:09:22.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-18T00:09:22.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676' 2026-02-18T00:09:22.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:22.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574859 2026-02-18T00:09:22.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574859 2026-02-18T00:09:22.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859' 2026-02-18T00:09:22.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:22.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444043 2026-02-18T00:09:22.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444043 2026-02-18T00:09:22.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043' 2026-02-18T00:09:22.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:22.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313226 2026-02-18T00:09:22.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313226 2026-02-18T00:09:22.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226' 2026-02-18T00:09:22.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:22.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182409 2026-02-18T00:09:22.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182409 2026-02-18T00:09:22.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409' 2026-02-18T00:09:22.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:22.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051593 2026-02-18T00:09:22.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051593 2026-02-18T00:09:22.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593' 2026-02-18T00:09:22.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:22.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920776 2026-02-18T00:09:22.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920776 2026-02-18T00:09:22.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776' 2026-02-18T00:09:22.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:22.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:23.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789960 2026-02-18T00:09:23.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789960 2026-02-18T00:09:23.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789960' 2026-02-18T00:09:23.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:23.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:23.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659143 2026-02-18T00:09:23.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659143 2026-02-18T00:09:23.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789960 9-176093659143' 2026-02-18T00:09:23.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:23.075 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:23.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528327 2026-02-18T00:09:23.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528327 2026-02-18T00:09:23.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789960 9-176093659143 10-193273528327' 2026-02-18T00:09:23.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:23.140 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-18T00:09:23.140 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:23.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:23.142 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836492 2026-02-18T00:09:23.142 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:23.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836492 2026-02-18T00:09:23.143 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836492 2026-02-18T00:09:23.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-18T00:09:23.143 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:23.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-18T00:09:23.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:09:24.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:09:24.367 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:24.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-18T00:09:24.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:24.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-18T00:09:24.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:24.596 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705676 2026-02-18T00:09:24.596 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:24.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705676 2026-02-18T00:09:24.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-18T00:09:24.597 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705676 2026-02-18T00:09:24.597 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:24.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-18T00:09:24.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:24.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574859 2026-02-18T00:09:24.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:24.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:24.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574859 2026-02-18T00:09:24.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:24.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574859 2026-02-18T00:09:24.827 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574859 2026-02-18T00:09:24.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2026-02-18T00:09:24.827 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:25.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-18T00:09:25.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:25.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444043 2026-02-18T00:09:25.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:25.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:25.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-73014444043 2026-02-18T00:09:25.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:25.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444043 2026-02-18T00:09:25.055 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 73014444043 2026-02-18T00:09:25.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 73014444043' 2026-02-18T00:09:25.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:25.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444043 -lt 73014444043 2026-02-18T00:09:25.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:25.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313226 2026-02-18T00:09:25.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:25.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:25.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313226 2026-02-18T00:09:25.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:25.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313226 2026-02-18T00:09:25.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313226' 2026-02-18T00:09:25.283 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 90194313226 2026-02-18T00:09:25.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:25.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313226 -lt 90194313226 2026-02-18T00:09:25.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:25.519 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182409 2026-02-18T00:09:25.519 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:25.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:25.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182409 2026-02-18T00:09:25.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:25.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182409 2026-02-18T00:09:25.521 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 107374182409 2026-02-18T00:09:25.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182409' 2026-02-18T00:09:25.522 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:25.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182410 -lt 107374182409 2026-02-18T00:09:25.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:25.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051593 2026-02-18T00:09:25.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:25.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:25.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051593 2026-02-18T00:09:25.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:25.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051593 2026-02-18T00:09:25.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051593' 2026-02-18T00:09:25.753 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 124554051593 2026-02-18T00:09:25.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:25.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051593 -lt 124554051593 2026-02-18T00:09:25.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:25.975 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920776 2026-02-18T00:09:25.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:25.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:25.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920776 2026-02-18T00:09:25.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:25.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920776 2026-02-18T00:09:25.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920776' 2026-02-18T00:09:25.978 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 141733920776 2026-02-18T00:09:25.978 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:26.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920777 -lt 141733920776 2026-02-18T00:09:26.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:26.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789960 2026-02-18T00:09:26.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:26.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:26.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789960 2026-02-18T00:09:26.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:26.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789960 2026-02-18T00:09:26.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789960' 2026-02-18T00:09:26.206 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 158913789960 2026-02-18T00:09:26.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:26.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789960 -lt 158913789960 2026-02-18T00:09:26.441 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:26.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659143 2026-02-18T00:09:26.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:26.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:26.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659143 2026-02-18T00:09:26.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:26.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659143 2026-02-18T00:09:26.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659143' 2026-02-18T00:09:26.445 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.9 seq 176093659143 2026-02-18T00:09:26.445 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:26.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659143 -lt 176093659143 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528327 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528327 2026-02-18T00:09:26.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:26.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528327 2026-02-18T00:09:26.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528327' 2026-02-18T00:09:26.669 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.10 seq 193273528327 2026-02-18T00:09:26.670 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:26.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528327 -lt 193273528327 2026-02-18T00:09:26.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:26.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:26.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:27.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T00:09:27.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:09:27.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:09:27.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T00:09:27.424 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:09:27.425 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:27.425 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:27.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T00:09:27.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:09:27.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:09:27.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: set 2026-02-18T00:09:27.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: local 'funcs=TEST_alignment_constraints 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:TEST_chunk_mapping 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_put_get_isa 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_put_get_jerasure 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_put_get_lrc_advanced 2026-02-18T00:09:27.736 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_put_get_lrc_kml 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_put_get_shec' 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_alignment_constraints td/test-erasure-code 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:253: TEST_alignment_constraints: local payload=ABC 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:254: TEST_alignment_constraints: echo ABC 2026-02-18T00:09:27.737 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-18T00:09:27.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: local stripe_unit=4096 2026-02-18T00:09:27.748 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: ceph osd erasure-code-profile get myprofile 2026-02-18T00:09:27.748 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: grep k= 2026-02-18T00:09:27.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: eval local k=2 2026-02-18T00:09:27.983 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: local k=2 2026-02-18T00:09:27.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:262: TEST_alignment_constraints: local block_size=8191 2026-02-18T00:09:27.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:263: TEST_alignment_constraints: dd if=/dev/zero of=td/test-erasure-code/ORIGINAL bs=8191 count=2 2026-02-18T00:09:27.983 INFO:tasks.workunit.client.0.trial061.stderr:2+0 records in 2026-02-18T00:09:27.983 INFO:tasks.workunit.client.0.trial061.stderr:2+0 records out 2026-02-18T00:09:27.984 INFO:tasks.workunit.client.0.trial061.stderr:16382 bytes (16 kB, 16 KiB) copied, 6.6834e-05 s, 245 MB/s 2026-02-18T00:09:27.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:264: TEST_alignment_constraints: rados --block-size=8191 --pool ecpool put UNALIGNED td/test-erasure-code/ORIGINAL 2026-02-18T00:09:28.001 INFO:tasks.workunit.client.0.trial061.stderr:INFO: op_size has been rounded to 8192 2026-02-18T00:09:28.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:266: TEST_alignment_constraints: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:09:28.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:09:28.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_chunk_mapping td/test-erasure-code 2026-02-18T00:09:28.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:304: TEST_chunk_mapping: local dir=td/test-erasure-code 2026-02-18T00:09:28.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:311: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code ecpool 0 1 2026-02-18T00:09:28.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-18T00:09:28.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=ecpool 2026-02-18T00:09:28.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=0 2026-02-18T00:09:28.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=1 2026-02-18T00:09:28.007 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-18T00:09:28.007 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-18T00:09:28.017 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-18T00:09:28.017 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTecpool 2026-02-18T00:09:28.018 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-18T00:09:28.018 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-18T00:09:28.030 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-18T00:09:28.030 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDecpool 2026-02-18T00:09:28.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTecpool SECONDecpool' 2026-02-18T00:09:28.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTecpool SECONDecpool' 2026-02-18T00:09:28.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool ecpool put SOMETHINGecpool td/test-erasure-code/ORIGINAL 2026-02-18T00:09:28.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool ecpool get SOMETHINGecpool td/test-erasure-code/COPY 2026-02-18T00:09:28.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-18T00:09:28.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-18T00:09:28.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGecpool 2026-02-18T00:09:28.071 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-18T00:09:28.071 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:09:28.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:09:28.297 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:28.297 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:28.297 INFO:tasks.workunit.client.0.trial061.stderr:0' 2026-02-18T00:09:28.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 2026-02-18T00:09:28.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-18T00:09:28.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-18T00:09:28.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-18T00:09:28.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-18T00:09:28.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.3 flush_journal 2026-02-18T00:09:28.355 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:28.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:28.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-18T00:09:28.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.5 flush_journal 2026-02-18T00:09:28.413 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:28.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:28.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-18T00:09:28.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-18T00:09:28.472 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:28.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:28.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-18T00:09:28.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.0 flush_journal 2026-02-18T00:09:28.532 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:28.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:28.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-18T00:09:28.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:09:28.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-18T00:09:28.536 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-18T00:09:28.536 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-18T00:09:28.536 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGecpool 2026-02-18T00:09:28.536 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-18T00:09:28.536 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:09:28.763 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr:0' 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-18T00:09:28.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:09:28.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.3 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTecpool 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:09:28.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-18T00:09:29.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:09:29.072 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/3 2026-02-18T00:09:29.072 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/3 SOMETHINGecpool get-bytes 2026-02-18T00:09:29.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 3 2026-02-18T00:09:29.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/3 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-18T00:09:29.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:29.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/3 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:start osd.3 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:29.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/3/whoami 2026-02-18T00:09:29.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:09:29.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:09:29.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:09:29.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:09:29.182 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:29.180+0000 7f400fad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:29.183 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:29.181+0000 7f400fad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:29.184 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:29.182+0000 7f400fad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:29.323 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:29.320+0000 7f400fad9900 -1 Falling back to public interface 2026-02-18T00:09:29.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:09:29.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:29.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:09:29.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:29.667 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:29.664+0000 7f400fad9900 -1 osd.3 63 log_to_monitors true 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:30.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 up in weight 1 up_from 67 up_thru 67 down_at 64 last_clean_interval [17,63) [v2:127.0.0.1:6826/1335095717,v1:127.0.0.1:6827/1335095717] [v2:127.0.0.1:6828/1335095717,v1:127.0.0.1:6829/1335095717] exists,up de64c189-f964-4ada-8f82-71989a030939 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:30.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:30.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:30.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:30.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:30.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:30.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:30.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:30.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:30.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:30.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:30.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:30.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:30.943 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:31.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:31.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:31.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.171 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:31.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-18T00:09:31.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-18T00:09:31.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495' 2026-02-18T00:09:31.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:31.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-18T00:09:31.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-18T00:09:31.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680' 2026-02-18T00:09:31.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.300 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574862 2026-02-18T00:09:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574862 2026-02-18T00:09:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862' 2026-02-18T00:09:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:31.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-18T00:09:31.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-18T00:09:31.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835' 2026-02-18T00:09:31.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.426 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:31.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313229 2026-02-18T00:09:31.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313229 2026-02-18T00:09:31.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229' 2026-02-18T00:09:31.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:31.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182413 2026-02-18T00:09:31.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182413 2026-02-18T00:09:31.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413' 2026-02-18T00:09:31.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.558 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051596 2026-02-18T00:09:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051596 2026-02-18T00:09:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596' 2026-02-18T00:09:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920780 2026-02-18T00:09:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920780 2026-02-18T00:09:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780' 2026-02-18T00:09:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:31.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-18T00:09:31.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-18T00:09:31.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789963' 2026-02-18T00:09:31.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:31.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659147 2026-02-18T00:09:31.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659147 2026-02-18T00:09:31.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789963 9-176093659147' 2026-02-18T00:09:31.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:31.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:31.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528330 2026-02-18T00:09:31.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528330 2026-02-18T00:09:31.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789963 9-176093659147 10-193273528330' 2026-02-18T00:09:31.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:31.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-18T00:09:31.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:31.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:31.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836495 2026-02-18T00:09:31.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:31.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836495 2026-02-18T00:09:31.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-18T00:09:31.881 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 21474836495 2026-02-18T00:09:31.882 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:32.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836495 -lt 21474836495 2026-02-18T00:09:32.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:32.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-18T00:09:32.104 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:32.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:32.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705680 2026-02-18T00:09:32.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:32.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705680 2026-02-18T00:09:32.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-18T00:09:32.106 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 38654705680 2026-02-18T00:09:32.106 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:32.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-18T00:09:32.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:32.337 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574862 2026-02-18T00:09:32.337 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:32.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:32.338 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574862 2026-02-18T00:09:32.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:32.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574862 2026-02-18T00:09:32.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574862' 2026-02-18T00:09:32.340 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 55834574862 2026-02-18T00:09:32.340 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:32.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574862 -lt 55834574862 2026-02-18T00:09:32.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:32.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808835 2026-02-18T00:09:32.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:32.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:32.566 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808835 2026-02-18T00:09:32.566 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:32.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808835 2026-02-18T00:09:32.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808835' 2026-02-18T00:09:32.567 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 287762808835 2026-02-18T00:09:32.567 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:32.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 287762808835 2026-02-18T00:09:32.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:09:33.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:09:33.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:34.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-18T00:09:34.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:34.016 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313229 2026-02-18T00:09:34.016 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:34.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:34.017 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313229 2026-02-18T00:09:34.017 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:34.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313229 2026-02-18T00:09:34.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313229' 2026-02-18T00:09:34.019 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.4 seq 90194313229 2026-02-18T00:09:34.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:34.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313230 -lt 90194313229 2026-02-18T00:09:34.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:34.248 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182413 2026-02-18T00:09:34.248 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:34.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:34.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182413 2026-02-18T00:09:34.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182413 2026-02-18T00:09:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182413' 2026-02-18T00:09:34.251 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.5 seq 107374182413 2026-02-18T00:09:34.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:34.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182413 -lt 107374182413 2026-02-18T00:09:34.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:34.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051596 2026-02-18T00:09:34.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:34.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:34.474 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051596 2026-02-18T00:09:34.474 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:34.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051596 2026-02-18T00:09:34.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051596' 2026-02-18T00:09:34.475 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.6 seq 124554051596 2026-02-18T00:09:34.475 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:34.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051597 -lt 124554051596 2026-02-18T00:09:34.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:34.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920780 2026-02-18T00:09:34.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:34.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:34.703 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920780 2026-02-18T00:09:34.703 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:34.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920780 2026-02-18T00:09:34.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920780' 2026-02-18T00:09:34.705 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.7 seq 141733920780 2026-02-18T00:09:34.705 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:34.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920780 -lt 141733920780 2026-02-18T00:09:34.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:34.939 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789963 2026-02-18T00:09:34.939 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:34.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:34.940 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789963 2026-02-18T00:09:34.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:34.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789963 2026-02-18T00:09:34.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789963' 2026-02-18T00:09:34.942 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.8 seq 158913789963 2026-02-18T00:09:34.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:35.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789964 -lt 158913789963 2026-02-18T00:09:35.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:35.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659147 2026-02-18T00:09:35.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:35.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:35.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659147 2026-02-18T00:09:35.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:35.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659147 2026-02-18T00:09:35.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659147' 2026-02-18T00:09:35.167 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.9 seq 176093659147 2026-02-18T00:09:35.167 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:35.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659147 -lt 176093659147 2026-02-18T00:09:35.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:35.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528330 2026-02-18T00:09:35.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:35.390 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:35.390 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528330 2026-02-18T00:09:35.390 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:35.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528330 2026-02-18T00:09:35.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528330' 2026-02-18T00:09:35.392 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.10 seq 193273528330 2026-02-18T00:09:35.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:35.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528331 -lt 193273528330 2026-02-18T00:09:35.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:35.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:35.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:09:35.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:09:36.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T00:09:36.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:09:36.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:36.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:36.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T00:09:36.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:09:36.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDecpool 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:09:36.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.5 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:09:36.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:09:36.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/5 2026-02-18T00:09:36.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/5 SOMETHINGecpool get-bytes 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 5 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/5 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:36.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:36.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:09:36.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/5 2026-02-18T00:09:36.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-18T00:09:36.879 INFO:tasks.workunit.client.0.trial061.stderr:start osd.5 2026-02-18T00:09:36.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:36.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/5/whoami 2026-02-18T00:09:36.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-18T00:09:36.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:09:36.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:09:36.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:09:36.890 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:36.887+0000 7fb606f48900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:36.892 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:36.888+0000 7fb606f48900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:36.893 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:36.889+0000 7fb606f48900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:37.038 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:37.034+0000 7fb606f48900 -1 Falling back to public interface 2026-02-18T00:09:37.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:37.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:09:37.336 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:37.366 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:37.363+0000 7fb606f48900 -1 osd.5 69 log_to_monitors true 2026-02-18T00:09:38.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:38.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:38.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:38.338 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:38.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:38.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:osd.5 up in weight 1 up_from 72 up_thru 72 down_at 69 last_clean_interval [25,69) [v2:127.0.0.1:6842/3644177397,v1:127.0.0.1:6843/3644177397] [v2:127.0.0.1:6844/3644177397,v1:127.0.0.1:6845/3644177397] exists,up 39eda364-29ac-486e-a205-95ec01b34ec6 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:38.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:38.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:38.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:38.865 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:38.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-18T00:09:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-18T00:09:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499' 2026-02-18T00:09:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:38.931 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:38.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705683 2026-02-18T00:09:38.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705683 2026-02-18T00:09:38.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683' 2026-02-18T00:09:38.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:38.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:39.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574866 2026-02-18T00:09:39.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574866 2026-02-18T00:09:39.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866' 2026-02-18T00:09:39.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.060 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808838 2026-02-18T00:09:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808838 2026-02-18T00:09:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838' 2026-02-18T00:09:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.124 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:39.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313233 2026-02-18T00:09:39.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313233 2026-02-18T00:09:39.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233' 2026-02-18T00:09:39.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:39.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645315 2026-02-18T00:09:39.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645315 2026-02-18T00:09:39.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315' 2026-02-18T00:09:39.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:39.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051600 2026-02-18T00:09:39.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051600 2026-02-18T00:09:39.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600' 2026-02-18T00:09:39.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:39.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920783 2026-02-18T00:09:39.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920783 2026-02-18T00:09:39.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783' 2026-02-18T00:09:39.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:39.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789967 2026-02-18T00:09:39.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789967 2026-02-18T00:09:39.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789967' 2026-02-18T00:09:39.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:39.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659150 2026-02-18T00:09:39.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659150 2026-02-18T00:09:39.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789967 9-176093659150' 2026-02-18T00:09:39.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:39.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:39.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528334 2026-02-18T00:09:39.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528334 2026-02-18T00:09:39.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789967 9-176093659150 10-193273528334' 2026-02-18T00:09:39.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:39.572 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-18T00:09:39.572 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:39.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:39.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836499 2026-02-18T00:09:39.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836499 2026-02-18T00:09:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-18T00:09:39.574 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 21474836499 2026-02-18T00:09:39.575 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:39.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836499 -lt 21474836499 2026-02-18T00:09:39.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:39.802 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705683 2026-02-18T00:09:39.802 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:39.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:39.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705683 2026-02-18T00:09:39.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:39.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705683 2026-02-18T00:09:39.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705683' 2026-02-18T00:09:39.805 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 38654705683 2026-02-18T00:09:39.805 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:40.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705683 -lt 38654705683 2026-02-18T00:09:40.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:40.038 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574866 2026-02-18T00:09:40.038 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:40.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:40.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574866 2026-02-18T00:09:40.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:40.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574866 2026-02-18T00:09:40.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574866' 2026-02-18T00:09:40.041 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 55834574866 2026-02-18T00:09:40.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:40.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574866 -lt 55834574866 2026-02-18T00:09:40.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:40.275 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808838 2026-02-18T00:09:40.275 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:40.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:40.276 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808838 2026-02-18T00:09:40.276 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:40.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808838 2026-02-18T00:09:40.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808838' 2026-02-18T00:09:40.277 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 287762808838 2026-02-18T00:09:40.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:40.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808838 -lt 287762808838 2026-02-18T00:09:40.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:40.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313233 2026-02-18T00:09:40.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:40.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:40.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313233 2026-02-18T00:09:40.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:40.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313233 2026-02-18T00:09:40.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313233' 2026-02-18T00:09:40.505 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.4 seq 90194313233 2026-02-18T00:09:40.505 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:40.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313233 -lt 90194313233 2026-02-18T00:09:40.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:40.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645315 2026-02-18T00:09:40.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:40.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:40.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645315 2026-02-18T00:09:40.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:40.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645315 2026-02-18T00:09:40.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645315' 2026-02-18T00:09:40.736 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.5 seq 309237645315 2026-02-18T00:09:40.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:40.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645315 -lt 309237645315 2026-02-18T00:09:40.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:40.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051600 2026-02-18T00:09:40.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:40.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:40.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051600 2026-02-18T00:09:40.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:40.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051600 2026-02-18T00:09:40.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051600' 2026-02-18T00:09:40.962 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.6 seq 124554051600 2026-02-18T00:09:40.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:41.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051600 -lt 124554051600 2026-02-18T00:09:41.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:41.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920783 2026-02-18T00:09:41.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:41.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:41.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920783 2026-02-18T00:09:41.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:41.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920783 2026-02-18T00:09:41.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920783' 2026-02-18T00:09:41.187 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.7 seq 141733920783 2026-02-18T00:09:41.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:41.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920784 -lt 141733920783 2026-02-18T00:09:41.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:41.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789967 2026-02-18T00:09:41.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:41.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:41.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789967 2026-02-18T00:09:41.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:41.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789967 2026-02-18T00:09:41.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789967' 2026-02-18T00:09:41.421 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.8 seq 158913789967 2026-02-18T00:09:41.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:41.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789967 -lt 158913789967 2026-02-18T00:09:41.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:41.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659150 2026-02-18T00:09:41.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:41.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:41.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659150 2026-02-18T00:09:41.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:41.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659150 2026-02-18T00:09:41.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659150' 2026-02-18T00:09:41.646 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.9 seq 176093659150 2026-02-18T00:09:41.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:41.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659151 -lt 176093659150 2026-02-18T00:09:41.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:41.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528334 2026-02-18T00:09:41.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:41.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:41.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528334 2026-02-18T00:09:41.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:41.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528334 2026-02-18T00:09:41.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528334' 2026-02-18T00:09:41.877 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.10 seq 193273528334 2026-02-18T00:09:41.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:42.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528334 -lt 193273528334 2026-02-18T00:09:42.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:42.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:42.104 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:09:42.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:09:42.412 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:09:42.412 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:09:42.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-18T00:09:42.632 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:09:42.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:42.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:42.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-18T00:09:42.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:09:42.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:09:42.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:313: TEST_chunk_mapping: ceph osd erasure-code-profile set remap-profile plugin=lrc 'layers=[ [ "cDD", "" ] ]' mapping=_DD 'crush-steps=[ [ "choose", "osd", 0 ] ]' 2026-02-18T00:09:43.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:318: TEST_chunk_mapping: ceph osd erasure-code-profile get remap-profile 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-device-class= 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-failure-domain=host 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-num-failure-domains=0 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-osds-per-failure-domain=0 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-root=default 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:crush-steps=[ [ "choose", "osd", 0 ] ] 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:k=-1 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:l=-1 2026-02-18T00:09:43.473 INFO:tasks.workunit.client.0.trial061.stdout:layers=[ [ "cDD", "" ] ] 2026-02-18T00:09:43.474 INFO:tasks.workunit.client.0.trial061.stdout:m=-1 2026-02-18T00:09:43.474 INFO:tasks.workunit.client.0.trial061.stdout:mapping=_DD 2026-02-18T00:09:43.474 INFO:tasks.workunit.client.0.trial061.stdout:plugin=lrc 2026-02-18T00:09:43.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:319: TEST_chunk_mapping: create_pool remap-pool 12 12 erasure remap-profile 2026-02-18T00:09:43.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create remap-pool 12 12 erasure remap-profile 2026-02-18T00:09:43.851 INFO:tasks.workunit.client.0.trial061.stderr:pool 'remap-pool' already exists 2026-02-18T00:09:43.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:09:44.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:327: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code remap-pool 1 2 2026-02-18T00:09:44.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-18T00:09:44.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=remap-pool 2026-02-18T00:09:44.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=1 2026-02-18T00:09:44.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=2 2026-02-18T00:09:44.863 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-18T00:09:44.863 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-18T00:09:44.875 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-18T00:09:44.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTremap-pool 2026-02-18T00:09:44.875 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-18T00:09:44.875 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-18T00:09:44.886 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-18T00:09:44.887 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDremap-pool 2026-02-18T00:09:44.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTremap-pool SECONDremap-pool' 2026-02-18T00:09:44.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTremap-pool SECONDremap-pool' 2026-02-18T00:09:44.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool remap-pool put SOMETHINGremap-pool td/test-erasure-code/ORIGINAL 2026-02-18T00:09:44.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool remap-pool get SOMETHINGremap-pool td/test-erasure-code/COPY 2026-02-18T00:09:44.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-18T00:09:44.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=remap-pool 2026-02-18T00:09:44.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGremap-pool 2026-02-18T00:09:44.926 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-18T00:09:44.926 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr:9' 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 6 9 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-18T00:09:45.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-18T00:09:45.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-18T00:09:45.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.4 flush_journal 2026-02-18T00:09:45.214 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:45.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:45.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-18T00:09:45.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.6 flush_journal 2026-02-18T00:09:45.274 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:45.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:45.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-18T00:09:45.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-18T00:09:45.331 INFO:tasks.workunit.client.0.trial061.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-18T00:09:45.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-18T00:09:45.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-18T00:09:45.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:09:45.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-18T00:09:45.335 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-18T00:09:45.335 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=remap-pool 2026-02-18T00:09:45.335 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGremap-pool 2026-02-18T00:09:45.335 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-18T00:09:45.336 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:09:45.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-18T00:09:45.563 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:9' 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 6 9 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTremap-pool 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=6 2026-02-18T00:09:45.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=6 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.6 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:09:45.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:09:45.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=6 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/6 2026-02-18T00:09:45.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/6 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 6 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=6 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/6 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:45.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/6 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.6 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:start osd.6 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 6 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/6/whoami 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 6 = 6 ']' 2026-02-18T00:09:45.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:09:45.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:09:45.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:09:45.770 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:45.767+0000 7ff6c0388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:45.772 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:45.768+0000 7ff6c0388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:45.773 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:45.769+0000 7ff6c0388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:45.978 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:45.975+0000 7ff6c0388900 -1 Falling back to public interface 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 6 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:45.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:09:46.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:46.290 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:46.287+0000 7ff6c0388900 -1 osd.6 81 log_to_monitors true 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:47.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:osd.6 up in weight 1 up_from 85 up_thru 85 down_at 82 last_clean_interval [29,81) [v2:127.0.0.1:6850/721930386,v1:127.0.0.1:6851/721930386] [v2:127.0.0.1:6852/721930386,v1:127.0.0.1:6853/721930386] exists,up 5af0fa87-324c-41ce-ab25-4b156aae6ef8 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:47.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:47.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:47.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:47.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:47.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:47.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:47.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:47.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:47.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:47.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-18T00:09:47.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-18T00:09:47.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503' 2026-02-18T00:09:47.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:47.800 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:47.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705687 2026-02-18T00:09:47.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705687 2026-02-18T00:09:47.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687' 2026-02-18T00:09:47.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:47.864 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:47.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574870 2026-02-18T00:09:47.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574870 2026-02-18T00:09:47.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870' 2026-02-18T00:09:47.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:47.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:47.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808842 2026-02-18T00:09:47.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808842 2026-02-18T00:09:47.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842' 2026-02-18T00:09:47.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:47.993 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:48.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313237 2026-02-18T00:09:48.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313237 2026-02-18T00:09:48.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237' 2026-02-18T00:09:48.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.058 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:48.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645319 2026-02-18T00:09:48.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645319 2026-02-18T00:09:48.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319' 2026-02-18T00:09:48.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:48.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220163 2026-02-18T00:09:48.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220163 2026-02-18T00:09:48.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-365072220163' 2026-02-18T00:09:48.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:48.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920787 2026-02-18T00:09:48.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920787 2026-02-18T00:09:48.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-365072220163 7-141733920787' 2026-02-18T00:09:48.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:48.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789971 2026-02-18T00:09:48.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789971 2026-02-18T00:09:48.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-365072220163 7-141733920787 8-158913789971' 2026-02-18T00:09:48.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.314 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:48.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659154 2026-02-18T00:09:48.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659154 2026-02-18T00:09:48.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-365072220163 7-141733920787 8-158913789971 9-176093659154' 2026-02-18T00:09:48.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:48.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:48.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528338 2026-02-18T00:09:48.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528338 2026-02-18T00:09:48.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-365072220163 7-141733920787 8-158913789971 9-176093659154 10-193273528338' 2026-02-18T00:09:48.441 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:48.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-18T00:09:48.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:48.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:48.442 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836503 2026-02-18T00:09:48.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:48.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836503 2026-02-18T00:09:48.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-18T00:09:48.444 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 21474836503 2026-02-18T00:09:48.444 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:48.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836500 -lt 21474836503 2026-02-18T00:09:48.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:09:49.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:09:49.672 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:49.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836503 -lt 21474836503 2026-02-18T00:09:49.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:49.905 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705687 2026-02-18T00:09:49.905 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:49.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:49.906 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705687 2026-02-18T00:09:49.906 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:49.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705687 2026-02-18T00:09:49.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-18T00:09:49.909 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 38654705687 2026-02-18T00:09:49.909 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:50.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-18T00:09:50.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:50.131 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574870 2026-02-18T00:09:50.131 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:50.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:50.132 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574870 2026-02-18T00:09:50.132 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:50.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574870 2026-02-18T00:09:50.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-18T00:09:50.133 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 55834574870 2026-02-18T00:09:50.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:50.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574870 -lt 55834574870 2026-02-18T00:09:50.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:50.357 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808842 2026-02-18T00:09:50.357 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:50.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:50.358 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808842 2026-02-18T00:09:50.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:50.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808842 2026-02-18T00:09:50.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808842' 2026-02-18T00:09:50.360 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 287762808842 2026-02-18T00:09:50.360 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:50.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808842 -lt 287762808842 2026-02-18T00:09:50.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:50.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313237 2026-02-18T00:09:50.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:50.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:50.581 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313237 2026-02-18T00:09:50.581 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:50.582 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313237 2026-02-18T00:09:50.582 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313237' 2026-02-18T00:09:50.583 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.4 seq 90194313237 2026-02-18T00:09:50.583 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:50.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313237 -lt 90194313237 2026-02-18T00:09:50.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:50.805 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645319 2026-02-18T00:09:50.805 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:50.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:50.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645319 2026-02-18T00:09:50.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:50.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645319 2026-02-18T00:09:50.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645319' 2026-02-18T00:09:50.808 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.5 seq 309237645319 2026-02-18T00:09:50.808 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:51.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645319 -lt 309237645319 2026-02-18T00:09:51.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:51.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-365072220163 2026-02-18T00:09:51.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:51.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:51.034 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-365072220163 2026-02-18T00:09:51.034 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:51.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=365072220163 2026-02-18T00:09:51.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 365072220163' 2026-02-18T00:09:51.035 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.6 seq 365072220163 2026-02-18T00:09:51.036 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:51.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 365072220163 -lt 365072220163 2026-02-18T00:09:51.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:51.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920787 2026-02-18T00:09:51.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:51.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:51.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920787 2026-02-18T00:09:51.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:51.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920787 2026-02-18T00:09:51.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920787' 2026-02-18T00:09:51.267 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.7 seq 141733920787 2026-02-18T00:09:51.268 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:51.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920788 -lt 141733920787 2026-02-18T00:09:51.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:51.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789971 2026-02-18T00:09:51.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:51.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:51.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789971 2026-02-18T00:09:51.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:51.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789971 2026-02-18T00:09:51.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789971' 2026-02-18T00:09:51.504 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.8 seq 158913789971 2026-02-18T00:09:51.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:51.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789971 -lt 158913789971 2026-02-18T00:09:51.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:51.728 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659154 2026-02-18T00:09:51.728 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:51.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:51.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659154 2026-02-18T00:09:51.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:51.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659154 2026-02-18T00:09:51.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659154' 2026-02-18T00:09:51.731 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.9 seq 176093659154 2026-02-18T00:09:51.731 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:51.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659155 -lt 176093659154 2026-02-18T00:09:51.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:51.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528338 2026-02-18T00:09:51.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:51.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:51.957 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528338 2026-02-18T00:09:51.957 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:51.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528338 2026-02-18T00:09:51.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528338' 2026-02-18T00:09:51.958 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.10 seq 193273528338 2026-02-18T00:09:51.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:52.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528338 -lt 193273528338 2026-02-18T00:09:52.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:52.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:52.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:52.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-18T00:09:52.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:09:52.491 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:09:52.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:09:52.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:09:52.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:09:52.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:09:52.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:09:52.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-18T00:09:52.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:09:52.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:52.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:09:53.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-18T00:09:53.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:09:53.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:09:53.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:53.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDremap-pool 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:09:53.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.9 2026-02-18T00:09:53.032 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:09:53.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:09:53.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:09:53.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:09:53.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:09:53.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/9 2026-02-18T00:09:53.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/9 SOMETHINGremap-pool get-bytes 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 9 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/9 2026-02-18T00:09:53.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:09:53.235 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:09:53.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/9 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr:start osd.9 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=18df7c12-125c-4c01-be99-5a1303e5e65d --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.45132/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:09:53.237 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/9/whoami 2026-02-18T00:09:53.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-18T00:09:53.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:09:53.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:09:53.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:09:53.250 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:53.247+0000 7fb4455e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:53.251 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:53.249+0000 7fb4455e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:53.252 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:53.249+0000 7fb4455e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:09:53.407 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:53.404+0000 7fb4455e0900 -1 Falling back to public interface 2026-02-18T00:09:53.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-18T00:09:53.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:53.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-18T00:09:53.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:09:53.731 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:09:53.729+0000 7fb4455e0900 -1 osd.9 86 log_to_monitors true 2026-02-18T00:09:54.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:09:54.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:09:54.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:09:54.688 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:54.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:09:54.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-18T00:09:54.913 INFO:tasks.workunit.client.0.trial061.stderr:osd.9 up in weight 1 up_from 90 up_thru 90 down_at 87 last_clean_interval [41,86) [v2:127.0.0.1:6874/1526154922,v1:127.0.0.1:6875/1526154922] [v2:127.0.0.1:6876/1526154922,v1:127.0.0.1:6877/1526154922] exists,up 58f8fccd-eca7-479c-a4ff-f8b0b3b38b42 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:09:54.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:09:54.915 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:09:54.915 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:09:54.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:09:54.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:09:54.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:09:54.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:09:54.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:09:54.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:09:55.220 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.221 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:09:55.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-18T00:09:55.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-18T00:09:55.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506' 2026-02-18T00:09:55.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.286 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:09:55.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-18T00:09:55.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-18T00:09:55.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691' 2026-02-18T00:09:55.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.351 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:09:55.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574873 2026-02-18T00:09:55.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574873 2026-02-18T00:09:55.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873' 2026-02-18T00:09:55.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:09:55.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808846 2026-02-18T00:09:55.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808846 2026-02-18T00:09:55.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846' 2026-02-18T00:09:55.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:09:55.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313240 2026-02-18T00:09:55.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313240 2026-02-18T00:09:55.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240' 2026-02-18T00:09:55.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.551 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:09:55.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645322 2026-02-18T00:09:55.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645322 2026-02-18T00:09:55.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322' 2026-02-18T00:09:55.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.615 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:09:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220166 2026-02-18T00:09:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220166 2026-02-18T00:09:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-365072220166' 2026-02-18T00:09:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:09:55.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920791 2026-02-18T00:09:55.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920791 2026-02-18T00:09:55.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-365072220166 7-141733920791' 2026-02-18T00:09:55.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.745 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:09:55.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789974 2026-02-18T00:09:55.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789974 2026-02-18T00:09:55.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-365072220166 7-141733920791 8-158913789974' 2026-02-18T00:09:55.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:09:55.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-18T00:09:55.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-18T00:09:55.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-365072220166 7-141733920791 8-158913789974 9-386547056643' 2026-02-18T00:09:55.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:09:55.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528341 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528341 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-365072220166 7-141733920791 8-158913789974 9-386547056643 10-193273528341' 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-18T00:09:55.937 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:55.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:09:55.938 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836506 2026-02-18T00:09:55.938 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:55.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836506 2026-02-18T00:09:55.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-18T00:09:55.940 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 21474836506 2026-02-18T00:09:55.940 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:09:56.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-18T00:09:56.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:56.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-18T00:09:56.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:56.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:09:56.171 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705691 2026-02-18T00:09:56.172 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:56.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705691 2026-02-18T00:09:56.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-18T00:09:56.173 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 38654705691 2026-02-18T00:09:56.173 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:09:56.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-18T00:09:56.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:56.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574873 2026-02-18T00:09:56.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:56.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:09:56.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574873 2026-02-18T00:09:56.412 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:56.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574873 2026-02-18T00:09:56.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574873' 2026-02-18T00:09:56.413 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 55834574873 2026-02-18T00:09:56.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:56.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574871 -lt 55834574873 2026-02-18T00:09:56.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:09:57.639 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:09:57.639 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:09:57.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574874 -lt 55834574873 2026-02-18T00:09:57.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:57.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808846 2026-02-18T00:09:57.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:57.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:09:57.863 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808846 2026-02-18T00:09:57.863 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:57.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808846 2026-02-18T00:09:57.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808846' 2026-02-18T00:09:57.864 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 287762808846 2026-02-18T00:09:57.864 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:09:58.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808846 -lt 287762808846 2026-02-18T00:09:58.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:58.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313240 2026-02-18T00:09:58.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:58.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:09:58.092 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313240 2026-02-18T00:09:58.092 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:58.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313240 2026-02-18T00:09:58.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313240' 2026-02-18T00:09:58.093 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.4 seq 90194313240 2026-02-18T00:09:58.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:09:58.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313240 -lt 90194313240 2026-02-18T00:09:58.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:58.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645322 2026-02-18T00:09:58.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:58.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:09:58.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645322 2026-02-18T00:09:58.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:58.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645322 2026-02-18T00:09:58.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645322' 2026-02-18T00:09:58.320 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.5 seq 309237645322 2026-02-18T00:09:58.320 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:09:58.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645322 -lt 309237645322 2026-02-18T00:09:58.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:58.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-365072220166 2026-02-18T00:09:58.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:58.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:09:58.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-365072220166 2026-02-18T00:09:58.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:58.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=365072220166 2026-02-18T00:09:58.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 365072220166' 2026-02-18T00:09:58.548 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.6 seq 365072220166 2026-02-18T00:09:58.548 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:09:58.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 365072220167 -lt 365072220166 2026-02-18T00:09:58.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:58.774 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920791 2026-02-18T00:09:58.774 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:58.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:09:58.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920791 2026-02-18T00:09:58.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:58.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920791 2026-02-18T00:09:58.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920791' 2026-02-18T00:09:58.777 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.7 seq 141733920791 2026-02-18T00:09:58.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:09:58.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920791 -lt 141733920791 2026-02-18T00:09:58.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:59.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789974 2026-02-18T00:09:59.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:59.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:09:59.001 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789974 2026-02-18T00:09:59.001 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:59.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789974 2026-02-18T00:09:59.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789974' 2026-02-18T00:09:59.002 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.8 seq 158913789974 2026-02-18T00:09:59.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:09:59.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789974 -lt 158913789974 2026-02-18T00:09:59.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:59.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056643 2026-02-18T00:09:59.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:59.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:09:59.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-386547056643 2026-02-18T00:09:59.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:59.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056643 2026-02-18T00:09:59.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 386547056643' 2026-02-18T00:09:59.231 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.9 seq 386547056643 2026-02-18T00:09:59.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:09:59.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056644 -lt 386547056643 2026-02-18T00:09:59.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:09:59.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528341 2026-02-18T00:09:59.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:09:59.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:09:59.457 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528341 2026-02-18T00:09:59.457 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:09:59.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528341 2026-02-18T00:09:59.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528341' 2026-02-18T00:09:59.458 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.10 seq 193273528341 2026-02-18T00:09:59.458 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:09:59.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528342 -lt 193273528341 2026-02-18T00:09:59.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:09:59.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:09:59.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:00.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-18T00:10:00.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:10:00.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:10:00.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-18T00:10:00.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:10:00.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:00.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:00.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-18T00:10:00.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:10:00.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:10:00.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:329: TEST_chunk_mapping: delete_pool remap-pool 2026-02-18T00:10:00.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=remap-pool 2026-02-18T00:10:00.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete remap-pool remap-pool --yes-i-really-really-mean-it 2026-02-18T00:10:00.813 INFO:tasks.workunit.client.0.trial061.stderr:pool 'remap-pool' does not exist 2026-02-18T00:10:00.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:330: TEST_chunk_mapping: ceph osd erasure-code-profile rm remap-profile 2026-02-18T00:10:01.098 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile remap-profile does not exist 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_isa td/test-erasure-code 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:193: TEST_rados_put_get_isa: erasure_code_plugin_exists isa 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2104: erasure_code_plugin_exists: local plugin=isa 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: erasure_code_plugin_exists: local status 2026-02-18T00:10:01.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: erasure_code_plugin_exists: local grepstr 2026-02-18T00:10:01.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2107: erasure_code_plugin_exists: local s 2026-02-18T00:10:01.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: case `uname` in 2026-02-18T00:10:01.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: uname 2026-02-18T00:10:01.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2110: erasure_code_plugin_exists: grepstr='isa.*No such file' 2026-02-18T00:10:01.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=isa 2026-02-18T00:10:01.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: s= 2026-02-18T00:10:01.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local status=0 2026-02-18T00:10:01.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2026-02-18T00:10:01.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2026-02-18T00:10:01.666 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile TESTPROFILE does not exist 2026-02-18T00:10:01.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: return 0 2026-02-18T00:10:01.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:197: TEST_rados_put_get_isa: local dir=td/test-erasure-code 2026-02-18T00:10:01.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:198: TEST_rados_put_get_isa: local poolname=pool-isa 2026-02-18T00:10:01.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:200: TEST_rados_put_get_isa: ceph osd erasure-code-profile set profile-isa plugin=isa crush-failure-domain=osd 2026-02-18T00:10:01.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:203: TEST_rados_put_get_isa: create_pool pool-isa 1 1 erasure profile-isa 2026-02-18T00:10:01.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-isa 1 1 erasure profile-isa 2026-02-18T00:10:02.328 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-isa' already exists 2026-02-18T00:10:02.336 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:10:03.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:206: TEST_rados_put_get_isa: rados_put_get td/test-erasure-code pool-isa 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-isa 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:03.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:10:03.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-isa put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:03.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:03.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:03.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:10:03.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-isa SOMETHING 2026-02-18T00:10:03.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-isa 2026-02-18T00:10:03.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:03.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-18T00:10:03.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:03.606 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-18T00:10:03.606 INFO:tasks.workunit.client.0.trial061.stderr:10 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 10 0 7 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('4' '10' '0' '7') 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=3 2026-02-18T00:10:03.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 7 2026-02-18T00:10:03.856 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already out. 2026-02-18T00:10:03.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:10:08.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-isa SOMETHING 2026-02-18T00:10:08.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-isa 2026-02-18T00:10:08.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:08.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<7\>' 2026-02-18T00:10:08.867 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-18T00:10:08.868 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:09.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-18T00:10:09.096 INFO:tasks.workunit.client.0.trial061.stderr:10 2026-02-18T00:10:09.096 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:09.096 INFO:tasks.workunit.client.0.trial061.stderr:1' 2026-02-18T00:10:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 10 0 1 2026-02-18T00:10:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:09.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:09.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 7 2026-02-18T00:10:09.344 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already in. 2026-02-18T00:10:09.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:09.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:208: TEST_rados_put_get_isa: delete_pool pool-isa 2026-02-18T00:10:09.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-isa 2026-02-18T00:10:09.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-isa pool-isa --yes-i-really-really-mean-it 2026-02-18T00:10:09.643 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-isa' does not exist 2026-02-18T00:10:09.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_jerasure td/test-erasure-code 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:212: TEST_rados_put_get_jerasure: local dir=td/test-erasure-code 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:214: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code ecpool 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=ecpool 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:10:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:10:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:10:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool ecpool put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:09.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:09.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:10:09.694 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds ecpool SOMETHING 2026-02-18T00:10:09.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-18T00:10:09.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:09.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-18T00:10:09.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:09.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=6 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:9' 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 6 0 7 9 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('6' '0' '7' '9') 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=3 2026-02-18T00:10:09.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 9 2026-02-18T00:10:10.175 INFO:tasks.workunit.client.0.trial061.stderr:osd.9 is already out. 2026-02-18T00:10:10.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:10:15.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds ecpool SOMETHING 2026-02-18T00:10:15.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<9\>' 2026-02-18T00:10:15.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-18T00:10:15.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:15.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-18T00:10:15.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:15.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=6 2026-02-18T00:10:15.412 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:15.412 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:15.412 INFO:tasks.workunit.client.0.trial061.stderr:5' 2026-02-18T00:10:15.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 6 0 7 5 2026-02-18T00:10:15.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:15.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:15.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 9 2026-02-18T00:10:15.661 INFO:tasks.workunit.client.0.trial061.stderr:osd.9 is already in. 2026-02-18T00:10:15.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:15.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:216: TEST_rados_put_get_jerasure: local poolname=pool-jerasure 2026-02-18T00:10:15.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:217: TEST_rados_put_get_jerasure: local profile=profile-jerasure 2026-02-18T00:10:15.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:219: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile set profile-jerasure plugin=jerasure k=4 m=2 crush-failure-domain=osd 2026-02-18T00:10:15.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:223: TEST_rados_put_get_jerasure: create_pool pool-jerasure 12 12 erasure profile-jerasure 2026-02-18T00:10:15.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 12 12 erasure profile-jerasure 2026-02-18T00:10:16.347 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:10:16.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:226: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code pool-jerasure 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-jerasure 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:10:17.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:17.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:17.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:17.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:10:17.401 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:17.401 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:17.401 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:17.402 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:17.402 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:17.630 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-18T00:10:17.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '1' '9' '4' '3' '10') 2026-02-18T00:10:17.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:10:17.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=5 2026-02-18T00:10:17.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 10 2026-02-18T00:10:17.879 INFO:tasks.workunit.client.0.trial061.stderr:osd.10 is already out. 2026-02-18T00:10:17.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:10:22.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:22.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:22.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:22.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<10\>' 2026-02-18T00:10:22.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:22.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:23.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 6 2026-02-18T00:10:23.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:23.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:23.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 10 2026-02-18T00:10:23.426 INFO:tasks.workunit.client.0.trial061.stderr:osd.10 is already in. 2026-02-18T00:10:23.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:227: TEST_rados_put_get_jerasure: rados_osds_out_in td/test-erasure-code pool-jerasure 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:104: rados_osds_out_in: local dir=td/test-erasure-code 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:105: rados_osds_out_in: local poolname=pool-jerasure 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:106: rados_osds_out_in: local objname=SOMETHING 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 FFFF 2026-02-18T00:10:23.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 GGGG 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 HHHH 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 IIII 2026-02-18T00:10:23.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:116: rados_osds_out_in: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:23.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:117: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:23.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:118: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:23.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:119: rados_osds_out_in: rm td/test-erasure-code/COPY 2026-02-18T00:10:23.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:127: rados_osds_out_in: wait_for_clean 2026-02-18T00:10:23.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:10:23.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:10:23.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:10:23.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:10:23.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:10:23.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:10:23.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:10:23.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:10:23.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:10:23.582 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:10:23.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:10:23.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:10:23.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:10:23.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:10:23.583 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:23.808 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:10:23.809 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:23.809 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:23.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:10:23.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:23.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:10:23.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-18T00:10:23.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-18T00:10:23.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514' 2026-02-18T00:10:23.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:23.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:10:23.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705698 2026-02-18T00:10:23.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705698 2026-02-18T00:10:23.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698' 2026-02-18T00:10:23.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:23.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:10:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574881 2026-02-18T00:10:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574881 2026-02-18T00:10:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881' 2026-02-18T00:10:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:23.998 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:10:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808853 2026-02-18T00:10:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808853 2026-02-18T00:10:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853' 2026-02-18T00:10:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.064 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:10:24.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313248 2026-02-18T00:10:24.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313248 2026-02-18T00:10:24.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248' 2026-02-18T00:10:24.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:10:24.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645330 2026-02-18T00:10:24.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645330 2026-02-18T00:10:24.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330' 2026-02-18T00:10:24.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:10:24.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220174 2026-02-18T00:10:24.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220174 2026-02-18T00:10:24.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330 6-365072220174' 2026-02-18T00:10:24.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:10:24.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920798 2026-02-18T00:10:24.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920798 2026-02-18T00:10:24.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330 6-365072220174 7-141733920798' 2026-02-18T00:10:24.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:10:24.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789982 2026-02-18T00:10:24.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789982 2026-02-18T00:10:24.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330 6-365072220174 7-141733920798 8-158913789982' 2026-02-18T00:10:24.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:10:24.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056651 2026-02-18T00:10:24.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056651 2026-02-18T00:10:24.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330 6-365072220174 7-141733920798 8-158913789982 9-386547056651' 2026-02-18T00:10:24.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:24.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:10:24.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528349 2026-02-18T00:10:24.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528349 2026-02-18T00:10:24.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808853 4-90194313248 5-309237645330 6-365072220174 7-141733920798 8-158913789982 9-386547056651 10-193273528349' 2026-02-18T00:10:24.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:24.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-18T00:10:24.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:24.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:10:24.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836514 2026-02-18T00:10:24.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:24.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836514 2026-02-18T00:10:24.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-18T00:10:24.518 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836514 2026-02-18T00:10:24.518 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:10:24.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836512 -lt 21474836514 2026-02-18T00:10:24.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:10:25.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:10:25.743 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:10:25.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836514 -lt 21474836514 2026-02-18T00:10:25.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:25.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705698 2026-02-18T00:10:25.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:25.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:10:25.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705698 2026-02-18T00:10:25.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:25.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705698 2026-02-18T00:10:25.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-18T00:10:25.966 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705698 2026-02-18T00:10:25.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:10:26.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705699 -lt 38654705698 2026-02-18T00:10:26.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:26.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574881 2026-02-18T00:10:26.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:26.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:10:26.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574881 2026-02-18T00:10:26.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:26.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574881 2026-02-18T00:10:26.195 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574881 2026-02-18T00:10:26.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-18T00:10:26.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:10:26.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574881 -lt 55834574881 2026-02-18T00:10:26.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:26.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808853 2026-02-18T00:10:26.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:26.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:10:26.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808853 2026-02-18T00:10:26.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:26.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808853 2026-02-18T00:10:26.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808853' 2026-02-18T00:10:26.421 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 287762808853 2026-02-18T00:10:26.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:10:26.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808854 -lt 287762808853 2026-02-18T00:10:26.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:26.651 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313248 2026-02-18T00:10:26.651 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:26.652 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:10:26.653 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313248 2026-02-18T00:10:26.653 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:26.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313248 2026-02-18T00:10:26.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313248' 2026-02-18T00:10:26.654 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 90194313248 2026-02-18T00:10:26.655 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:10:26.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313248 -lt 90194313248 2026-02-18T00:10:26.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:26.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645330 2026-02-18T00:10:26.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:26.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:10:26.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645330 2026-02-18T00:10:26.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:26.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645330 2026-02-18T00:10:26.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645330' 2026-02-18T00:10:26.882 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 309237645330 2026-02-18T00:10:26.882 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:10:27.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645330 -lt 309237645330 2026-02-18T00:10:27.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:27.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-365072220174 2026-02-18T00:10:27.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:27.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:10:27.110 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-365072220174 2026-02-18T00:10:27.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:27.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=365072220174 2026-02-18T00:10:27.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 365072220174' 2026-02-18T00:10:27.112 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 365072220174 2026-02-18T00:10:27.112 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:10:27.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 365072220174 -lt 365072220174 2026-02-18T00:10:27.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:27.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920798 2026-02-18T00:10:27.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:27.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:10:27.336 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920798 2026-02-18T00:10:27.336 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:27.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920798 2026-02-18T00:10:27.337 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 141733920798 2026-02-18T00:10:27.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920798' 2026-02-18T00:10:27.338 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:10:27.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920799 -lt 141733920798 2026-02-18T00:10:27.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:27.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789982 2026-02-18T00:10:27.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:27.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:10:27.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789982 2026-02-18T00:10:27.566 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:27.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789982 2026-02-18T00:10:27.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789982' 2026-02-18T00:10:27.567 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 158913789982 2026-02-18T00:10:27.567 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:10:27.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789982 -lt 158913789982 2026-02-18T00:10:27.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:27.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056651 2026-02-18T00:10:27.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:27.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:10:27.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-386547056651 2026-02-18T00:10:27.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:27.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056651 2026-02-18T00:10:27.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 386547056651' 2026-02-18T00:10:27.796 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.9 seq 386547056651 2026-02-18T00:10:27.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:10:28.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056651 -lt 386547056651 2026-02-18T00:10:28.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:28.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528349 2026-02-18T00:10:28.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:28.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:10:28.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528349 2026-02-18T00:10:28.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:28.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528349 2026-02-18T00:10:28.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528349' 2026-02-18T00:10:28.022 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.10 seq 193273528349 2026-02-18T00:10:28.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:10:28.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528349 -lt 193273528349 2026-02-18T00:10:28.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:10:28.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:28.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:28.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-18T00:10:28.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:10:28.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:10:28.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:10:28.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:10:28.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:10:28.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:10:28.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:10:28.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-18T00:10:28.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:10:28.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:28.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:29.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-18T00:10:29.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:10:29.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:10:29.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:29.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:29.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:29.091 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:29.091 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:29.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: local 'osds_list=5 1 9 4 3 10' 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: osds=('5' '1' '9' '4' '3' '10') 2026-02-18T00:10:29.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: local -a osds 2026-02-18T00:10:29.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:29.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 5 2026-02-18T00:10:29.569 INFO:tasks.workunit.client.0.trial061.stderr:osd.5 is already out. 2026-02-18T00:10:29.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:29.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 1 2026-02-18T00:10:29.874 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 is already out. 2026-02-18T00:10:29.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:133: rados_osds_out_in: wait_for_clean 2026-02-18T00:10:29.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:10:29.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:10:29.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:10:29.883 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:10:29.884 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:10:29.884 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:10:29.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:10:29.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:10:29.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:10:29.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:10:30.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:10:30.190 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:30.190 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:10:30.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:10:30.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-18T00:10:30.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-18T00:10:30.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517' 2026-02-18T00:10:30.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.254 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:10:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705702 2026-02-18T00:10:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705702 2026-02-18T00:10:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702' 2026-02-18T00:10:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:10:30.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574884 2026-02-18T00:10:30.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574884 2026-02-18T00:10:30.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884' 2026-02-18T00:10:30.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:10:30.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808857 2026-02-18T00:10:30.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808857 2026-02-18T00:10:30.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857' 2026-02-18T00:10:30.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.450 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:10:30.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313251 2026-02-18T00:10:30.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313251 2026-02-18T00:10:30.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251' 2026-02-18T00:10:30.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:10:30.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645333 2026-02-18T00:10:30.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645333 2026-02-18T00:10:30.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333' 2026-02-18T00:10:30.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:10:30.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220177 2026-02-18T00:10:30.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220177 2026-02-18T00:10:30.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-365072220177' 2026-02-18T00:10:30.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:10:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920802 2026-02-18T00:10:30.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920802 2026-02-18T00:10:30.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-365072220177 7-141733920802' 2026-02-18T00:10:30.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:10:30.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789985 2026-02-18T00:10:30.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789985 2026-02-18T00:10:30.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-365072220177 7-141733920802 8-158913789985' 2026-02-18T00:10:30.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.769 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:10:30.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056654 2026-02-18T00:10:30.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056654 2026-02-18T00:10:30.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-365072220177 7-141733920802 8-158913789985 9-386547056654' 2026-02-18T00:10:30.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:30.834 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:10:30.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528352 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528352 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-365072220177 7-141733920802 8-158913789985 9-386547056654 10-193273528352' 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:30.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:10:30.900 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836517 2026-02-18T00:10:30.900 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:30.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836517 2026-02-18T00:10:30.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-18T00:10:30.902 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836517 2026-02-18T00:10:30.902 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:10:31.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836515 -lt 21474836517 2026-02-18T00:10:31.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:10:32.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:10:32.126 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:10:32.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836517 -lt 21474836517 2026-02-18T00:10:32.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:32.353 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705702 2026-02-18T00:10:32.353 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:32.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:10:32.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705702 2026-02-18T00:10:32.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:32.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705702 2026-02-18T00:10:32.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705702' 2026-02-18T00:10:32.356 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705702 2026-02-18T00:10:32.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:10:32.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705702 -lt 38654705702 2026-02-18T00:10:32.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:32.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574884 2026-02-18T00:10:32.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:32.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:10:32.583 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574884 2026-02-18T00:10:32.584 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:32.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574884 2026-02-18T00:10:32.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574884' 2026-02-18T00:10:32.585 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574884 2026-02-18T00:10:32.585 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:10:32.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574884 -lt 55834574884 2026-02-18T00:10:32.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:32.808 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808857 2026-02-18T00:10:32.808 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:32.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:10:32.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808857 2026-02-18T00:10:32.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:32.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808857 2026-02-18T00:10:32.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808857' 2026-02-18T00:10:32.811 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 287762808857 2026-02-18T00:10:32.811 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:10:33.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808857 -lt 287762808857 2026-02-18T00:10:33.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:33.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313251 2026-02-18T00:10:33.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:33.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:10:33.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313251 2026-02-18T00:10:33.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:33.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313251 2026-02-18T00:10:33.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313251' 2026-02-18T00:10:33.046 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 90194313251 2026-02-18T00:10:33.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:10:33.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313251 -lt 90194313251 2026-02-18T00:10:33.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:33.271 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645333 2026-02-18T00:10:33.271 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:33.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:10:33.272 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645333 2026-02-18T00:10:33.272 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:33.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645333 2026-02-18T00:10:33.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645333' 2026-02-18T00:10:33.274 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 309237645333 2026-02-18T00:10:33.274 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:10:33.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645334 -lt 309237645333 2026-02-18T00:10:33.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:33.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-365072220177 2026-02-18T00:10:33.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:33.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:10:33.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-365072220177 2026-02-18T00:10:33.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:33.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=365072220177 2026-02-18T00:10:33.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 365072220177' 2026-02-18T00:10:33.510 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 365072220177 2026-02-18T00:10:33.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:10:33.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 365072220178 -lt 365072220177 2026-02-18T00:10:33.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:33.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920802 2026-02-18T00:10:33.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:33.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:10:33.737 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920802 2026-02-18T00:10:33.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:33.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920802 2026-02-18T00:10:33.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920802' 2026-02-18T00:10:33.739 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 141733920802 2026-02-18T00:10:33.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:10:33.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920802 -lt 141733920802 2026-02-18T00:10:33.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:33.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789985 2026-02-18T00:10:33.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:33.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:10:33.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789985 2026-02-18T00:10:33.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:33.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789985 2026-02-18T00:10:33.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789985' 2026-02-18T00:10:33.968 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 158913789985 2026-02-18T00:10:33.968 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:10:34.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789986 -lt 158913789985 2026-02-18T00:10:34.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:34.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056654 2026-02-18T00:10:34.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:34.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:10:34.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-386547056654 2026-02-18T00:10:34.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:34.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056654 2026-02-18T00:10:34.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 386547056654' 2026-02-18T00:10:34.196 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.9 seq 386547056654 2026-02-18T00:10:34.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:10:34.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056654 -lt 386547056654 2026-02-18T00:10:34.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:34.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528352 2026-02-18T00:10:34.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:34.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:10:34.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528352 2026-02-18T00:10:34.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:34.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528352 2026-02-18T00:10:34.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528352' 2026-02-18T00:10:34.422 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.10 seq 193273528352 2026-02-18T00:10:34.423 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:10:34.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528353 -lt 193273528352 2026-02-18T00:10:34.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:10:34.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:34.647 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:10:34.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:10:34.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:10:35.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-18T00:10:35.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:10:35.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:35.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:35.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<5\>' 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:35.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 7 9 4 3 10 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:35.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<1\>' 2026-02-18T00:10:35.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:35.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:35.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-18T00:10:35.961 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:35.961 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:35.961 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:35.962 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:35.962 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:35.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 7 9 4 3 10 2026-02-18T00:10:35.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:140: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:35.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:141: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:35.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:35.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 5 2026-02-18T00:10:36.268 INFO:tasks.workunit.client.0.trial061.stderr:osd.5 is already in. 2026-02-18T00:10:36.276 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-18T00:10:36.276 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 1 2026-02-18T00:10:36.569 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 is already in. 2026-02-18T00:10:36.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:150: rados_osds_out_in: wait_for_clean 2026-02-18T00:10:36.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:10:36.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:10:36.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:10:36.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:10:36.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:10:36.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:10:36.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:10:36.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:10:36.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:10:36.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:10:36.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:8 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:10:36.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:36.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:10:36.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836520 2026-02-18T00:10:36.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836520 2026-02-18T00:10:36.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520' 2026-02-18T00:10:36.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:36.953 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:10:37.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705705 2026-02-18T00:10:37.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705705 2026-02-18T00:10:37.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705' 2026-02-18T00:10:37.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:10:37.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574887 2026-02-18T00:10:37.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574887 2026-02-18T00:10:37.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887' 2026-02-18T00:10:37.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:10:37.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808860 2026-02-18T00:10:37.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808860 2026-02-18T00:10:37.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860' 2026-02-18T00:10:37.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.150 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:10:37.215 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313254 2026-02-18T00:10:37.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313254 2026-02-18T00:10:37.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254' 2026-02-18T00:10:37.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.216 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:10:37.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645336 2026-02-18T00:10:37.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645336 2026-02-18T00:10:37.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336' 2026-02-18T00:10:37.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:10:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220181 2026-02-18T00:10:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220181 2026-02-18T00:10:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336 6-365072220181' 2026-02-18T00:10:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:10:37.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920805 2026-02-18T00:10:37.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920805 2026-02-18T00:10:37.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336 6-365072220181 7-141733920805' 2026-02-18T00:10:37.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:10:37.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789988 2026-02-18T00:10:37.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789988 2026-02-18T00:10:37.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336 6-365072220181 7-141733920805 8-158913789988' 2026-02-18T00:10:37.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-18T00:10:37.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056657 2026-02-18T00:10:37.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056657 2026-02-18T00:10:37.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336 6-365072220181 7-141733920805 8-158913789988 9-386547056657' 2026-02-18T00:10:37.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:10:37.538 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-18T00:10:37.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528355 2026-02-18T00:10:37.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528355 2026-02-18T00:10:37.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645336 6-365072220181 7-141733920805 8-158913789988 9-386547056657 10-193273528355' 2026-02-18T00:10:37.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:37.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836520 2026-02-18T00:10:37.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:37.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:10:37.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836520 2026-02-18T00:10:37.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:37.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836520 2026-02-18T00:10:37.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2026-02-18T00:10:37.605 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 21474836520 2026-02-18T00:10:37.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:10:37.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836520 -lt 21474836520 2026-02-18T00:10:37.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:37.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705705 2026-02-18T00:10:37.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:37.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:10:37.831 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705705 2026-02-18T00:10:37.831 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:37.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705705 2026-02-18T00:10:37.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705705' 2026-02-18T00:10:37.833 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 38654705705 2026-02-18T00:10:37.833 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:10:38.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705705 -lt 38654705705 2026-02-18T00:10:38.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:38.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574887 2026-02-18T00:10:38.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:38.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:10:38.065 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574887 2026-02-18T00:10:38.065 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:38.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574887 2026-02-18T00:10:38.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574887' 2026-02-18T00:10:38.067 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 55834574887 2026-02-18T00:10:38.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:10:38.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574888 -lt 55834574887 2026-02-18T00:10:38.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:38.290 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808860 2026-02-18T00:10:38.290 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:38.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:10:38.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808860 2026-02-18T00:10:38.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:38.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808860 2026-02-18T00:10:38.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808860' 2026-02-18T00:10:38.292 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 287762808860 2026-02-18T00:10:38.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:10:38.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808860 -lt 287762808860 2026-02-18T00:10:38.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:38.518 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313254 2026-02-18T00:10:38.519 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:38.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:10:38.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313254 2026-02-18T00:10:38.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:38.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313254 2026-02-18T00:10:38.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313254' 2026-02-18T00:10:38.521 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 90194313254 2026-02-18T00:10:38.522 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:10:38.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313254 -lt 90194313254 2026-02-18T00:10:38.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:38.755 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645336 2026-02-18T00:10:38.756 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:38.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:10:38.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645336 2026-02-18T00:10:38.757 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:38.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645336 2026-02-18T00:10:38.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645336' 2026-02-18T00:10:38.759 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 309237645336 2026-02-18T00:10:38.759 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:10:38.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645336 -lt 309237645336 2026-02-18T00:10:38.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:38.983 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-365072220181 2026-02-18T00:10:38.983 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:38.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:10:38.985 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-365072220181 2026-02-18T00:10:38.985 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:38.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=365072220181 2026-02-18T00:10:38.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 365072220181' 2026-02-18T00:10:38.987 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 365072220181 2026-02-18T00:10:38.987 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:10:39.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 365072220181 -lt 365072220181 2026-02-18T00:10:39.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:39.210 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920805 2026-02-18T00:10:39.210 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:39.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:10:39.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920805 2026-02-18T00:10:39.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:39.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920805 2026-02-18T00:10:39.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920805' 2026-02-18T00:10:39.213 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 141733920805 2026-02-18T00:10:39.213 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:10:39.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920805 -lt 141733920805 2026-02-18T00:10:39.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:39.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789988 2026-02-18T00:10:39.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:39.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:10:39.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789988 2026-02-18T00:10:39.440 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:39.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789988 2026-02-18T00:10:39.441 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 158913789988 2026-02-18T00:10:39.441 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789988' 2026-02-18T00:10:39.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:10:39.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789989 -lt 158913789988 2026-02-18T00:10:39.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:39.672 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056657 2026-02-18T00:10:39.673 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:39.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-18T00:10:39.674 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-386547056657 2026-02-18T00:10:39.674 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:39.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056657 2026-02-18T00:10:39.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 386547056657' 2026-02-18T00:10:39.675 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.9 seq 386547056657 2026-02-18T00:10:39.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-18T00:10:39.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056658 -lt 386547056657 2026-02-18T00:10:39.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:10:39.895 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528355 2026-02-18T00:10:39.895 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:10:39.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-18T00:10:39.896 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528355 2026-02-18T00:10:39.896 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:10:39.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528355 2026-02-18T00:10:39.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528355' 2026-02-18T00:10:39.898 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.10 seq 193273528355 2026-02-18T00:10:39.898 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-18T00:10:40.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528356 -lt 193273528355 2026-02-18T00:10:40.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:10:40.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:40.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:40.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-18T00:10:40.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:10:40.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:10:40.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:10:40.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:10:40.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:10:40.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:10:40.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:10:40.678 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-18T00:10:40.678 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:10:40.679 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:10:40.679 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:10:40.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-18T00:10:40.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:10:40.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:10:40.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-18T00:10:40.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:10:40.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:40.988 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-18T00:10:40.988 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:41.210 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:41.210 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:10' 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: test '5 1 9 4 3 10' = '5 1 9 4 3 10' 2026-02-18T00:10:41.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:152: rados_osds_out_in: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:41.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:229: TEST_rados_put_get_jerasure: delete_pool pool-jerasure 2026-02-18T00:10:41.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-jerasure 2026-02-18T00:10:41.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:10:41.457 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:10:41.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:230: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile rm profile-jerasure 2026-02-18T00:10:41.739 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile profile-jerasure does not exist 2026-02-18T00:10:41.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:10:41.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_advanced td/test-erasure-code 2026-02-18T00:10:41.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:156: TEST_rados_put_get_lrc_advanced: local dir=td/test-erasure-code 2026-02-18T00:10:41.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:157: TEST_rados_put_get_lrc_advanced: local poolname=pool-lrc-a 2026-02-18T00:10:41.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:158: TEST_rados_put_get_lrc_advanced: local profile=profile-lrc-a 2026-02-18T00:10:41.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:160: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile set profile-lrc-a plugin=lrc mapping=DD_ 'crush-steps=[ [ "chooseleaf", "osd", 0 ] ]' 'layers=[ [ "DDc", "" ] ]' 2026-02-18T00:10:42.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:165: TEST_rados_put_get_lrc_advanced: create_pool pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-18T00:10:42.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-18T00:10:42.406 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-lrc-a' already exists 2026-02-18T00:10:42.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:10:43.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:168: TEST_rados_put_get_lrc_advanced: rados_put_get td/test-erasure-code pool-lrc-a 2026-02-18T00:10:43.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:10:43.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc-a 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:10:43.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc-a put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:43.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:43.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:43.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:10:43.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-18T00:10:43.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc-a 2026-02-18T00:10:43.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:43.461 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-18T00:10:43.461 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 9 3 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '9' '3') 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-18T00:10:43.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 3 2026-02-18T00:10:43.969 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 is already out. 2026-02-18T00:10:43.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:10:48.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-18T00:10:48.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc-a 2026-02-18T00:10:48.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:48.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<3\>' 2026-02-18T00:10:48.981 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-18T00:10:48.982 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:49.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-18T00:10:49.220 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:49.220 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:10:49.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 9 7 2026-02-18T00:10:49.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:49.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:49.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 3 2026-02-18T00:10:49.564 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 is already in. 2026-02-18T00:10:49.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:49.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:170: TEST_rados_put_get_lrc_advanced: delete_pool pool-lrc-a 2026-02-18T00:10:49.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-lrc-a 2026-02-18T00:10:49.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-lrc-a pool-lrc-a --yes-i-really-really-mean-it 2026-02-18T00:10:49.865 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-lrc-a' does not exist 2026-02-18T00:10:49.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:171: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile rm profile-lrc-a 2026-02-18T00:10:50.147 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile profile-lrc-a does not exist 2026-02-18T00:10:50.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:10:50.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_kml td/test-erasure-code 2026-02-18T00:10:50.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:175: TEST_rados_put_get_lrc_kml: local dir=td/test-erasure-code 2026-02-18T00:10:50.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:176: TEST_rados_put_get_lrc_kml: local poolname=pool-lrc 2026-02-18T00:10:50.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:177: TEST_rados_put_get_lrc_kml: local profile=profile-lrc 2026-02-18T00:10:50.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:179: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile set profile-lrc plugin=lrc k=4 m=2 l=3 crush-failure-domain=osd 2026-02-18T00:10:50.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:183: TEST_rados_put_get_lrc_kml: create_pool pool-lrc 12 12 erasure profile-lrc 2026-02-18T00:10:50.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-lrc 12 12 erasure profile-lrc 2026-02-18T00:10:50.812 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-lrc' already exists 2026-02-18T00:10:50.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:186: TEST_rados_put_get_lrc_kml: rados_put_get td/test-erasure-code pool-lrc 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:10:51.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:10:51.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:10:51.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:51.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:51.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:10:51.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-18T00:10:51.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc 2026-02-18T00:10:51.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:51.866 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-18T00:10:51.866 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:52.092 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=8 2026-02-18T00:10:52.092 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:10 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 8 6 0 10 5 3 9 7 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('8' '6' '0' '10' '5' '3' '9' '7') 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=7 2026-02-18T00:10:52.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 7 2026-02-18T00:10:52.342 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already out. 2026-02-18T00:10:52.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:10:57.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-18T00:10:57.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<7\>' 2026-02-18T00:10:57.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc 2026-02-18T00:10:57.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:10:57.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-18T00:10:57.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:10:57.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=8 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:10 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:4' 2026-02-18T00:10:57.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 8 6 0 10 5 3 9 4 2026-02-18T00:10:57.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:10:57.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:10:57.611 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 7 2026-02-18T00:10:57.888 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already in. 2026-02-18T00:10:57.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:10:57.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:188: TEST_rados_put_get_lrc_kml: delete_pool pool-lrc 2026-02-18T00:10:57.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-lrc 2026-02-18T00:10:57.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-lrc pool-lrc --yes-i-really-really-mean-it 2026-02-18T00:10:58.188 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-lrc' does not exist 2026-02-18T00:10:58.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:189: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile rm profile-lrc 2026-02-18T00:10:58.469 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile profile-lrc does not exist 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_shec td/test-erasure-code 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:234: TEST_rados_put_get_shec: local dir=td/test-erasure-code 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:236: TEST_rados_put_get_shec: local poolname=pool-shec 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:237: TEST_rados_put_get_shec: local profile=profile-shec 2026-02-18T00:10:58.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:239: TEST_rados_put_get_shec: ceph osd erasure-code-profile set profile-shec plugin=shec k=2 m=1 c=1 crush-failure-domain=osd 2026-02-18T00:10:58.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:243: TEST_rados_put_get_shec: create_pool pool-shec 12 12 erasure profile-shec 2026-02-18T00:10:58.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-shec 12 12 erasure profile-shec 2026-02-18T00:10:59.140 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-shec' already exists 2026-02-18T00:10:59.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:246: TEST_rados_put_get_shec: rados_put_get td/test-erasure-code pool-shec 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-shec 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-18T00:11:00.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-shec put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-18T00:11:00.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:11:00.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:11:00.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-18T00:11:00.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-shec SOMETHING 2026-02-18T00:11:00.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-shec 2026-02-18T00:11:00.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:11:00.195 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-18T00:11:00.195 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:11:00.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=7 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:1' 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 7 9 1 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('7' '9' '1') 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-18T00:11:00.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 1 2026-02-18T00:11:00.699 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 is already out. 2026-02-18T00:11:00.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-18T00:11:05.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-shec SOMETHING 2026-02-18T00:11:05.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-shec 2026-02-18T00:11:05.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-18T00:11:05.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<1\>' 2026-02-18T00:11:05.711 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-18T00:11:05.711 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:11:05.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=7 2026-02-18T00:11:05.941 INFO:tasks.workunit.client.0.trial061.stderr:9 2026-02-18T00:11:05.941 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:11:05.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 7 9 6 2026-02-18T00:11:05.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-18T00:11:05.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-18T00:11:05.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 1 2026-02-18T00:11:06.239 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 is already in. 2026-02-18T00:11:06.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-18T00:11:06.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:248: TEST_rados_put_get_shec: delete_pool pool-shec 2026-02-18T00:11:06.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-shec 2026-02-18T00:11:06.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-shec pool-shec --yes-i-really-really-mean-it 2026-02-18T00:11:06.541 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-shec' does not exist 2026-02-18T00:11:06.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:249: TEST_rados_put_get_shec: ceph osd erasure-code-profile rm profile-shec 2026-02-18T00:11:06.831 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile profile-shec does not exist 2026-02-18T00:11:06.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:51: run: delete_pool ecpool 2026-02-18T00:11:06.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=ecpool 2026-02-18T00:11:06.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete ecpool ecpool --yes-i-really-really-mean-it 2026-02-18T00:11:07.110 INFO:tasks.workunit.client.0.trial061.stderr:pool 'ecpool' does not exist 2026-02-18T00:11:07.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:52: run: teardown td/test-erasure-code 2026-02-18T00:11:07.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:11:07.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:11:07.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:11:07.233 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:11:07.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:11:07.233 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:11:07.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:11:07.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:11:07.235 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:11:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:11:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:11:07.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:11:07.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:11:07.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-18T00:11:07.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:11:07.291 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:11:07.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.45132 2026-02-18T00:11:07.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:11:07.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:11:07.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-code 0 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:11:07.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:11:07.295 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:11:07.295 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:11:07.295 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:11:07.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:11:07.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:11:07.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:11:07.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:11:07.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:11:07.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:11:07.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:11:07.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:11:07.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-18T00:11:07.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:11:07.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.45132 2026-02-18T00:11:07.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.45132 2026-02-18T00:11:07.303 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:11:07.303 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:11:07.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:11:07.304 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:11:07.305 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:11:07.370 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-eio.sh... 2026-02-18T00:11:07.371 DEBUG:teuthology.orchestra.run.trial061:workunit test erasure-code/test-erasure-eio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=adc1923395f2bcd6ae89b5d331d278364d1848ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh 2026-02-18T00:11:07.434 INFO:tasks.workunit.client.0.trial061.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-18T00:11:07.438 INFO:tasks.workunit.client.0.trial061.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-eio 2026-02-18T00:11:07.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:22: run: local dir=td/test-erasure-eio 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:23: run: shift 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: export CEPH_MON=127.0.0.1:7112 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: CEPH_MON=127.0.0.1:7112 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:26: run: export CEPH_ARGS 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: uuidgen 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: CEPH_ARGS+='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none ' 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7112 ' 2026-02-18T00:11:07.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:29: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2026-02-18T00:11:07.442 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: set 2026-02-18T00:11:07.442 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-18T00:11:07.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: local 'funcs=TEST_ec_backfill_unfound 2026-02-18T00:11:07.442 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_object_attr_read_error 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_recovery_multiple_errors 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_recovery_multiple_objects 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_recovery_multiple_objects_eio 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_recovery_unfound 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_ec_single_recovery_error 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_bad_size_shard_0 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_bad_size_shard_1 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_subread_eio_shard_0 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_subread_eio_shard_1 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_subread_missing 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_with_subreadall_eio_shard_0 2026-02-18T00:11:07.443 INFO:tasks.workunit.client.0.trial061.stderr:TEST_rados_get_with_subreadall_eio_shard_1' 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:11:07.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:11:07.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:11:07.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:11:07.447 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:11:07.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:11:07.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:11:07.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:11:07.448 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:11:07.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:11:07.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:11:07.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:11:07.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:11:07.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:11:07.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:11:07.453 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:11:07.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:11:07.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:07.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:11:07.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:11:07.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:11:07.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:11:07.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:11:07.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:11:07.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:11:07.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.548 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:11:07.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:11:07.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:11:07.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:11:07.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:11:07.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:11:07.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:11:07.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:11:07.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:11:07.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:11:07.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:11:07.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:07.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:07.696 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:07.697 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:07.697 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:07.697 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:07.697 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:11:07.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:11:07.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:11:07.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:11:07.810 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:11:07.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:11:08.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:11:08.862 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:11:08.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:11:08.868 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:11:07.489+0000 7f524e3ddd80 0 load: jerasure load: lrc 2026-02-18T00:11:08.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_backfill_unfound td/test-erasure-eio 2026-02-18T00:11:08.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:531: TEST_ec_backfill_unfound: local dir=td/test-erasure-eio 2026-02-18T00:11:08.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:532: TEST_ec_backfill_unfound: local objname=myobject 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:533: TEST_ec_backfill_unfound: local lastobj=300 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:535: TEST_ec_backfill_unfound: local testobj=obj250 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:537: TEST_ec_backfill_unfound: ORIG_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:538: TEST_ec_backfill_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: setup_osds 5 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:11:08.870 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-18T00:11:08.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:08.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:08.876 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:08.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a5a2e34a-8033-4129-96c8-552544e37cef 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a5a2e34a-8033-4129-96c8-552544e37cef' 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 a5a2e34a-8033-4129-96c8-552544e37cef 2026-02-18T00:11:08.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:11:08.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCcA5Vpd7DENBAACZ6y5c/IXT3B5DYkjmrqDQ== 2026-02-18T00:11:08.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCcA5Vpd7DENBAACZ6y5c/IXT3B5DYkjmrqDQ=="}' 2026-02-18T00:11:08.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a5a2e34a-8033-4129-96c8-552544e37cef -i td/test-erasure-eio/0/new.json 2026-02-18T00:11:08.992 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:08.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:11:09.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcA5Vpd7DENBAACZ6y5c/IXT3B5DYkjmrqDQ== --osd-uuid a5a2e34a-8033-4129-96c8-552544e37cef 2026-02-18T00:11:09.020 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.016+0000 7feedf3ed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.022 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.019+0000 7feedf3ed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.023 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.020+0000 7feedf3ed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.023 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.020+0000 7feedf3ed900 -1 bdev(0x5643755c4c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:11:09.024 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.020+0000 7feedf3ed900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:11:09.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:11:09.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:11:09.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:11:09.466 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:11:09.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:11:09.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:11:09.572 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:11:09.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:09.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:11:09.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:11:09.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:11:09.591 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.587+0000 7fe9709c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.589+0000 7fe9709c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.593 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.590+0000 7fe9709c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:11:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:11:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:09.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:09.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:09.673 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:09.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:09.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:11:09.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:09.809 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:09.806+0000 7fe9709c1900 -1 Falling back to public interface 2026-02-18T00:11:10.100 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:10.097+0000 7fe9709c1900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:11:10.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:10.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:10.775 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:10.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:10.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:10.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:11:11.006 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4203785972,v1:127.0.0.1:6803/4203785972] [v2:127.0.0.1:6804/4203785972,v1:127.0.0.1:6805/4203785972] exists,up a5a2e34a-8033-4129-96c8-552544e37cef 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:11.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:11:11.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:11.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=60237d40-3b7d-4096-86c4-e3704d792633 2026-02-18T00:11:11.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 60237d40-3b7d-4096-86c4-e3704d792633' 2026-02-18T00:11:11.014 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 60237d40-3b7d-4096-86c4-e3704d792633 2026-02-18T00:11:11.014 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:11:11.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCfA5VpwXU1ARAAUVZK80PVgwEwo+rcfTP7dw== 2026-02-18T00:11:11.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCfA5VpwXU1ARAAUVZK80PVgwEwo+rcfTP7dw=="}' 2026-02-18T00:11:11.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 60237d40-3b7d-4096-86c4-e3704d792633 -i td/test-erasure-eio/1/new.json 2026-02-18T00:11:11.251 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:11.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:11:11.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCfA5VpwXU1ARAAUVZK80PVgwEwo+rcfTP7dw== --osd-uuid 60237d40-3b7d-4096-86c4-e3704d792633 2026-02-18T00:11:11.281 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.277+0000 7f8d44812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:11.282 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.279+0000 7f8d44812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:11.283 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.280+0000 7f8d44812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:11.283 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.280+0000 7f8d44812900 -1 bdev(0x557f09fecc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:11:11.284 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.280+0000 7f8d44812900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:11:11.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:11:11.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:11:11.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:11:11.596 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:11:11.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:11:11.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:11:11.921 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:11:11.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:11.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:11:11.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:11:11.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:11:11.940 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.937+0000 7f8b62cba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:11.942 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.938+0000 7f8b62cba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:11.942 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:11.939+0000 7f8b62cba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:12.121 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:12.117+0000 7f8b62cba900 -1 Falling back to public interface 2026-02-18T00:11:12.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:11:12.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:12.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:11:12.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:12.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:12.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:12.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:12.147 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:12.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:12.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:11:12.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:12.455 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:12.452+0000 7f8b62cba900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:11:13.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:13.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:13.382 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:13.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:13.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:13.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:11:13.608 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3797133635,v1:127.0.0.1:6811/3797133635] [v2:127.0.0.1:6812/3797133635,v1:127.0.0.1:6813/3797133635] exists,up 60237d40-3b7d-4096-86c4-e3704d792633 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:11:13.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:11:13.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:11:13.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 87d075a0-aa0d-41bc-8538-eb5ba3c1b240' 2026-02-18T00:11:13.616 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:13.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:11:13.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQChA5VpfbUpJRAAsg6Fdgx9YoJB2qy5jMG6DA== 2026-02-18T00:11:13.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQChA5VpfbUpJRAAsg6Fdgx9YoJB2qy5jMG6DA=="}' 2026-02-18T00:11:13.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 -i td/test-erasure-eio/2/new.json 2026-02-18T00:11:13.852 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:11:13.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:11:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQChA5VpfbUpJRAAsg6Fdgx9YoJB2qy5jMG6DA== --osd-uuid 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:13.880 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:13.877+0000 7f024b895900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:13.882 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:13.878+0000 7f024b895900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:13.883 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:13.879+0000 7f024b895900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:13.883 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:13.880+0000 7f024b895900 -1 bdev(0x55761d778c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:11:13.883 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:13.880+0000 7f024b895900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:11:14.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:11:14.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:11:14.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:11:14.201 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:11:14.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:11:14.512 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:11:14.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:11:14.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:14.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:11:14.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:11:14.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:11:14.531 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:14.528+0000 7f3ecb20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:14.532 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:14.529+0000 7f3ecb20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:14.533 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:14.530+0000 7f3ecb20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:14.666 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:14.662+0000 7f3ecb20d900 -1 Falling back to public interface 2026-02-18T00:11:14.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:14.745 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:14.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:14.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:14.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:15.002 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:14.999+0000 7f3ecb20d900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:11:15.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:15.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:15.972 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:15.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:15.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:15.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:16.198 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/533696752,v1:127.0.0.1:6819/533696752] [v2:127.0.0.1:6820/533696752,v1:127.0.0.1:6821/533696752] exists,up 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:16.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:11:16.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:16.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:16.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:11:16.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=771a8b73-fb5f-4b12-9be0-51a015c8914f 2026-02-18T00:11:16.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 771a8b73-fb5f-4b12-9be0-51a015c8914f' 2026-02-18T00:11:16.206 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 771a8b73-fb5f-4b12-9be0-51a015c8914f 2026-02-18T00:11:16.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:11:16.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCkA5Vpx6G3DBAABfUtQQ8OmGBCHp0TE/54bg== 2026-02-18T00:11:16.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCkA5Vpx6G3DBAABfUtQQ8OmGBCHp0TE/54bg=="}' 2026-02-18T00:11:16.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 771a8b73-fb5f-4b12-9be0-51a015c8914f -i td/test-erasure-eio/3/new.json 2026-02-18T00:11:16.444 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:11:16.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:11:16.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCkA5Vpx6G3DBAABfUtQQ8OmGBCHp0TE/54bg== --osd-uuid 771a8b73-fb5f-4b12-9be0-51a015c8914f 2026-02-18T00:11:16.473 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:16.470+0000 7f44c6f42900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:16.474 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:16.471+0000 7f44c6f42900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:16.475 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:16.472+0000 7f44c6f42900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:16.476 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:16.472+0000 7f44c6f42900 -1 bdev(0x5604ce676c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:11:16.476 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:16.473+0000 7f44c6f42900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:11:16.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:11:16.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:11:16.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:11:16.802 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:11:16.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:11:17.116 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:11:17.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:11:17.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:17.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:11:17.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:11:17.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:11:17.136 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:17.132+0000 7f7d28505900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:17.137 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:17.134+0000 7f7d28505900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:17.138 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:17.135+0000 7f7d28505900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:17.288 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:17.285+0000 7f7d28505900 -1 Falling back to public interface 2026-02-18T00:11:17.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:17.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:17.345 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:17.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:17.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:11:17.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:17.658 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:17.655+0000 7f7d28505900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:11:18.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:18.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:18.570 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:18.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:18.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:18.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:11:18.798 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3245816846,v1:127.0.0.1:6827/3245816846] [v2:127.0.0.1:6828/3245816846,v1:127.0.0.1:6829/3245816846] exists,up 771a8b73-fb5f-4b12-9be0-51a015c8914f 2026-02-18T00:11:18.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:18.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c5aa71bc-fa84-430a-a340-fa84c45a885b 2026-02-18T00:11:18.806 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 c5aa71bc-fa84-430a-a340-fa84c45a885b 2026-02-18T00:11:18.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 c5aa71bc-fa84-430a-a340-fa84c45a885b' 2026-02-18T00:11:18.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:11:18.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCmA5VpI9RZMBAAy+gnpXud7KEV89nKjwWONA== 2026-02-18T00:11:18.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCmA5VpI9RZMBAAy+gnpXud7KEV89nKjwWONA=="}' 2026-02-18T00:11:18.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c5aa71bc-fa84-430a-a340-fa84c45a885b -i td/test-erasure-eio/4/new.json 2026-02-18T00:11:19.041 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:11:19.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:11:19.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmA5VpI9RZMBAAy+gnpXud7KEV89nKjwWONA== --osd-uuid c5aa71bc-fa84-430a-a340-fa84c45a885b 2026-02-18T00:11:19.070 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.067+0000 7f1737f8e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.071 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.068+0000 7f1737f8e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.072 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.069+0000 7f1737f8e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.072 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.069+0000 7f1737f8e900 -1 bdev(0x5597d7b14c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:11:19.072 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.069+0000 7f1737f8e900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:11:19.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:11:19.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:11:19.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:11:19.415 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:11:19.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:11:19.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:11:19.740 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:11:19.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:19.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:11:19.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:11:19.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:11:19.758 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.755+0000 7fdf1caf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.759 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.756+0000 7fdf1caf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.760 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.757+0000 7fdf1caf1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:19.913 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:19.910+0000 7fdf1caf1900 -1 Falling back to public interface 2026-02-18T00:11:19.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:11:19.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:19.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:11:19.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:19.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:19.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:19.966 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:19.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:19.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:19.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:11:20.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:20.228 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:20.225+0000 7fdf1caf1900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:11:21.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:21.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:21.190 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:21.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:21.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:21.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:11:21.422 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 34 up_thru 35 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4097531517,v1:127.0.0.1:6835/4097531517] [v2:127.0.0.1:6836/4097531517,v1:127.0.0.1:6837/4097531517] exists,up c5aa71bc-fa84-430a-a340-fa84c45a885b 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:21.424 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:21.425 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:21.425 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:11:21.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:11:21.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:11:21.469 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:11:21.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:11:21.476 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:11:09.809+0000 7fe9709c1900 0 load: jerasure load: lrc 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:540: TEST_ec_backfill_unfound: CEPH_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:542: TEST_ec_backfill_unfound: local poolname=pool-jerasure 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:543: TEST_ec_backfill_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:11:21.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:11:21.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:11:21.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:11:22.134 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:11:22.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:11:23.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:11:23.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:11:23.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:11:23.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:11:23.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:11:23.145 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:11:23.145 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:11:23.145 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:11:23.145 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:11:23.145 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:11:23.227 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:11:23.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:11:23.452 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:11:23.452 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:11:23.452 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:11:23.452 INFO:tasks.workunit.client.0.trial061.stderr:4' 2026-02-18T00:11:23.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:11:23.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:11:23.453 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:11:23.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-18T00:11:23.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-18T00:11:23.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-18T00:11:23.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:11:23.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:11:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607557 2026-02-18T00:11:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607557 2026-02-18T00:11:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557' 2026-02-18T00:11:23.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:11:23.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:11:23.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444036 2026-02-18T00:11:23.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444036 2026-02-18T00:11:23.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036' 2026-02-18T00:11:23.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:11:23.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:11:23.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-18T00:11:23.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-18T00:11:23.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036 3-107374182403' 2026-02-18T00:11:23.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:11:23.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:11:23.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-18T00:11:23.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-18T00:11:23.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036 3-107374182403 4-146028888067' 2026-02-18T00:11:23.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:11:23.770 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-18T00:11:23.770 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:11:23.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:11:23.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-18T00:11:23.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:11:23.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-18T00:11:23.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-18T00:11:23.773 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803781 2026-02-18T00:11:23.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:11:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803781 2026-02-18T00:11:23.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:11:23.999 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607557 2026-02-18T00:11:23.999 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:11:23.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:11:24.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607557 2026-02-18T00:11:24.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:11:24.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607557 2026-02-18T00:11:24.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607557' 2026-02-18T00:11:24.002 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607557 2026-02-18T00:11:24.002 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:11:24.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607557 -lt 51539607557 2026-02-18T00:11:24.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:11:24.223 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444036 2026-02-18T00:11:24.224 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:11:24.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:11:24.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444036 2026-02-18T00:11:24.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:11:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444036 2026-02-18T00:11:24.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444036' 2026-02-18T00:11:24.226 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 73014444036 2026-02-18T00:11:24.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:11:24.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444036 -lt 73014444036 2026-02-18T00:11:24.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:11:24.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182403 2026-02-18T00:11:24.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:11:24.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:11:24.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182403 2026-02-18T00:11:24.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:11:24.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182403 2026-02-18T00:11:24.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-18T00:11:24.457 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182403 2026-02-18T00:11:24.457 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:11:24.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-18T00:11:24.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:11:24.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888067 2026-02-18T00:11:24.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:11:24.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:11:24.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888067 2026-02-18T00:11:24.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:11:24.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888067 2026-02-18T00:11:24.685 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888067 2026-02-18T00:11:24.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888067' 2026-02-18T00:11:24.685 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:11:24.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888065 -lt 146028888067 2026-02-18T00:11:24.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:11:25.911 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:11:25.912 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:11:26.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-18T00:11:26.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:11:26.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:11:26.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:11:26.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:11:26.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:11:26.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:11:26.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:11:26.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:11:26.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:11:26.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:11:26.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:11:26.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:11:26.675 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:11:26.675 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:11:26.675 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:11:26.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:11:26.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:11:26.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:11:26.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:545: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-18T00:11:27.199 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:11:27.199 INFO:tasks.workunit.client.0.trial061.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:23.101162+0000 0'0 41:16 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-18T00:11:22.069915+0000 0'0 2026-02-18T00:11:22.069915+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:05:28.844423+0000 0 0 2026-02-18T00:11:27.199 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.688750+0000 0'0 40:19 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:40:15.071078+0000 0 0 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.537949+0000 0'0 40:93 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:30:14.384745+0000 0 0 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.651652+0000 0'0 40:19 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:02:32.381022+0000 0 0 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:15.664946+0000 0'0 40:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:51:08.893773+0000 0 0 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:11:27.200 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:547: TEST_ec_backfill_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:27.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:11:27.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:27.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:11:27.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:11:27.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:11:27.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:27.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:548: TEST_ec_backfill_unfound: get_primary pool-jerasure myobject 2026-02-18T00:11:27.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=pool-jerasure 2026-02-18T00:11:27.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=myobject 2026-02-18T00:11:27.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:11:27.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-18T00:11:27.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:548: TEST_ec_backfill_unfound: local primary=3 2026-02-18T00:11:27.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: get_osds pool-jerasure myobject 2026-02-18T00:11:27.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:11:27.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:11:27.464 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:11:27.464 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2 2026-02-18T00:11:27.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: local -a initial_osds 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:551: TEST_ec_backfill_unfound: local last_osd=2 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:552: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:11:27.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:11:27.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:11:27.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:553: TEST_ec_backfill_unfound: ceph osd down 2 2026-02-18T00:11:28.025 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already down. 2026-02-18T00:11:28.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:554: TEST_ec_backfill_unfound: ceph osd out 2 2026-02-18T00:11:28.310 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already out. 2026-02-18T00:11:28.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:556: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-18T00:11:28.535 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:11:28.535 INFO:tasks.workunit.client.0.trial061.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:23.101162+0000 0'0 41:16 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-18T00:11:22.069915+0000 0'0 2026-02-18T00:11:22.069915+0000 0 0 periodic scrub scheduled @ 2026-02-19T11:05:28.844423+0000 0 0 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.688750+0000 0'0 41:21 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:40:15.071078+0000 0 0 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.537949+0000 0'0 41:95 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:30:14.384745+0000 0 0 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.651652+0000 0'0 41:21 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:02:32.381022+0000 0 0 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:15.664946+0000 0'0 40:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:51:08.893773+0000 0 0 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:11:28.536 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:11:28.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:558: TEST_ec_backfill_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-18T00:11:28.545 INFO:tasks.workunit.client.0.trial061.stderr:4+0 records in 2026-02-18T00:11:28.545 INFO:tasks.workunit.client.0.trial061.stderr:4+0 records out 2026-02-18T00:11:28.545 INFO:tasks.workunit.client.0.trial061.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.7625e-05 s, 52.8 MB/s 2026-02-18T00:11:28.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: seq 1 300 2026-02-18T00:11:28.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.811 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.811 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:28.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:28.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:29.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:29.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj101 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj102 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj103 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj104 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj105 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj106 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj107 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj108 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj109 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj110 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj111 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj112 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj113 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj114 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj115 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj116 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj117 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj118 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj119 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj120 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj121 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj122 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj123 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.846 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.846 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj124 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj125 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj126 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj127 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj128 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj129 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj130 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj131 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:30.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:30.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj132 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj133 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj134 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj135 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj136 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj137 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj138 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj139 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj140 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj141 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj142 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj143 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj144 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj145 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj146 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj147 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj148 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj149 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj150 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj151 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj152 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj153 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj154 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj155 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj156 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj157 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj158 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj159 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj160 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj161 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj162 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj163 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj164 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj165 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj166 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj167 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.658 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.658 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj168 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj169 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj170 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj171 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj172 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj173 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj174 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj175 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj176 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj177 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj178 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj179 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj180 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj181 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj182 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj183 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj184 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj185 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:31.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:31.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj186 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj187 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj188 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj189 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj190 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj191 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj192 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj193 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj194 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj195 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj196 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj197 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj198 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj199 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj200 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj201 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj202 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj203 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj204 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj205 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj206 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj207 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj208 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj209 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj210 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj211 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj212 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj213 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj214 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj215 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj216 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj217 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj218 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj219 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj220 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj221 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj222 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj223 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj224 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj225 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj226 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj227 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj228 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj229 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj230 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj231 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj232 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj233 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj234 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj235 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj236 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj237 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj238 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj239 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:32.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:32.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj240 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj241 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj242 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj243 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.072 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj244 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj245 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj246 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj247 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj248 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj249 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj250 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj251 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj252 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj253 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj254 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj255 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj256 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj257 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj258 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj259 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj260 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj261 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj262 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj263 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.445 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj264 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj265 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj266 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj267 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj268 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj269 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj270 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj271 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj272 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj273 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj274 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj275 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.664 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.664 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj276 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj277 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj278 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj279 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj280 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj281 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj282 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj283 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.811 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.811 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj284 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj285 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj286 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj287 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj288 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj289 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj290 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj291 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj292 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj293 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:33.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:33.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj294 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj295 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj296 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj297 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj298 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj299 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:11:34.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj300 td/test-erasure-eio/ORIGINAL 2026-02-18T00:11:34.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:564: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 0 2026-02-18T00:11:34.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:11:34.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj250 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj250 2026-02-18T00:11:34.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:11:34.130 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj250 2026-02-18T00:11:34.130 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-18T00:11:34.130 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:11:34.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:11:34.354 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:11:34.354 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:11:34.354 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr:2147483647' 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:11:34.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:11:34.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:11:34.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:11:34.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:11:34.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:11:34.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:11:34.358 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:11:34.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:11:34.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:11:34.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:11:34.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:11:34.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure obj250 0 2026-02-18T00:11:34.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:565: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 1 2026-02-18T00:11:34.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:11:34.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj250 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj250 2026-02-18T00:11:34.460 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:11:34.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj250 2026-02-18T00:11:34.461 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-18T00:11:34.461 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:11:34.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:2147483647' 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:11:34.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T00:11:34.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:11:34.682 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-18T00:11:34.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:34.684 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:34.685 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:34.685 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:11:34.685 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:11:34.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:11:34.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:11:34.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:11:34.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T00:11:34.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:11:34.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.1.asok injectdataerr pool-jerasure obj250 1 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:567: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:11:34.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:34.787 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:11:34.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:11:34.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:11:34.789 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:11:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:11:34.801 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:34.798+0000 7fa49fde0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:34.802 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:34.799+0000 7fa49fde0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:34.803 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:34.800+0000 7fa49fde0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:34.944 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:34.940+0000 7fa49fde0900 -1 Falling back to public interface 2026-02-18T00:11:35.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:11:35.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:35.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:11:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:35.010 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:35.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:35.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:35.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:35.232 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:35.228+0000 7fa49fde0900 -1 osd.2 41 log_to_monitors true 2026-02-18T00:11:35.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:36.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:36.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:36.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:36.242 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:36.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:36.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:36.473 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up out weight 0 up_from 47 up_thru 17 down_at 42 last_clean_interval [17,41) [v2:127.0.0.1:6818/2212172839,v1:127.0.0.1:6819/2212172839] [v2:127.0.0.1:6820/2212172839,v1:127.0.0.1:6821/2212172839] exists,up 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:36.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:36.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:36.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:36.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:568: TEST_ec_backfill_unfound: ceph osd in 2 2026-02-18T00:11:36.720 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already in. 2026-02-18T00:11:36.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:570: TEST_ec_backfill_unfound: sleep 15 2026-02-18T00:11:51.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: seq 1 240 2026-02-18T00:11:51.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: for tmp in $(seq 1 240) 2026-02-18T00:11:51.731 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:573: TEST_ec_backfill_unfound: get_state 2.0 2026-02-18T00:11:51.731 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-18T00:11:51.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-18T00:11:51.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-18T00:11:51.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-18T00:11:51.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:573: TEST_ec_backfill_unfound: state=active+backfill_unfound+undersized+degraded+remapped 2026-02-18T00:11:51.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:574: TEST_ec_backfill_unfound: echo active+backfill_unfound+undersized+degraded+remapped 2026-02-18T00:11:51.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:574: TEST_ec_backfill_unfound: grep backfill_unfound 2026-02-18T00:11:51.952 INFO:tasks.workunit.client.0.trial061.stdout:active+backfill_unfound+undersized+degraded+remapped 2026-02-18T00:11:51.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: '[' 0 = 0 ']' 2026-02-18T00:11:51.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:576: TEST_ec_backfill_unfound: break 2026-02-18T00:11:51.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:582: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-18T00:11:52.170 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:11:52.170 INFO:tasks.workunit.client.0.trial061.stdout:2.0 301 1 28 0 1 1232896 0 0 101 200 101 active+backfill_unfound+undersized+degraded+remapped 2026-02-18T00:11:37.500052+0000 45'301 53:907 [3,1,4,0,2] 3 [3,1,4,0,NONE] 3 0'0 2026-02-18T00:11:22.069915+0000 0'0 2026-02-18T00:11:22.069915+0000 0 0 no scrub is scheduled 0 0 2026-02-18T00:11:52.170 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:36.755297+0000 0'0 53:63 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T09:31:22.535654+0000 0 0 2026-02-18T00:11:52.170 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.537949+0000 0'0 53:118 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:30:14.384745+0000 0 0 2026-02-18T00:11:52.170 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.651652+0000 0'0 53:45 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:02:32.381022+0000 0 0 2026-02-18T00:11:52.171 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:36.755534+0000 0'0 53:107 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:52:01.071502+0000 0 0 2026-02-18T00:11:52.171 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:11:52.171 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:11:52.171 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:11:52.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:583: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:11:52.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:11:52.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:11:52.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:11:52.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:11:52.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:11:52.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:11:52.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:584: TEST_ec_backfill_unfound: sleep 5 2026-02-18T00:11:57.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:586: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-18T00:11:57.703 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:11:57.703 INFO:tasks.workunit.client.0.trial061.stdout:2.0 301 1 303 0 1 1232896 0 0 101 200 101 active+recovery_unfound+undersized+degraded 2026-02-18T00:11:52.335591+0000 45'301 55:919 [3,1,4,0,NONE] 3 [3,1,4,0,NONE] 3 0'0 2026-02-18T00:11:22.069915+0000 0'0 2026-02-18T00:11:22.069915+0000 0 0 no scrub is scheduled 0 0 2026-02-18T00:11:57.703 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:36.755297+0000 0'0 53:63 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T09:31:22.535654+0000 0 0 2026-02-18T00:11:57.703 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.537949+0000 0'0 53:118 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T04:30:14.384745+0000 0 0 2026-02-18T00:11:57.703 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:11:21.651652+0000 0'0 53:45 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:02:32.381022+0000 0 0 2026-02-18T00:11:57.704 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+undersized 2026-02-18T00:11:52.333756+0000 0'0 55:115 [1,0] 1 [1,0] 1 0'0 2026-02-18T00:11:07.789944+0000 0'0 2026-02-18T00:11:07.789944+0000 0 0 periodic scrub scheduled @ 2026-02-19T06:36:47.614373+0000 0 0 2026-02-18T00:11:57.704 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:11:57.704 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:11:57.704 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:11:57.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:587: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout:{ 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "num_missing": 1, 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "num_unfound": 1, 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "objects": [ 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "oid": { 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "oid": "obj250", 2026-02-18T00:11:57.773 INFO:tasks.workunit.client.0.trial061.stdout: "key": "", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "snapid": -2, 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "hash": 2249616407, 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "max": 0, 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "pool": 2, 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "namespace": "" 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "need": "45'251", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "have": "0'0", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "flags": "none", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "locations": [ 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.774 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: ] 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "state": "NotRecovering", 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "available_might_have_unfound": true, 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "might_have_unfound": [ 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "2(4)", 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "status": "osd is down" 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.775 INFO:tasks.workunit.client.0.trial061.stdout: "more": false 2026-02-18T00:11:57.776 INFO:tasks.workunit.client.0.trial061.stdout:} 2026-02-18T00:11:57.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:588: TEST_ec_backfill_unfound: ceph pg 2.0 query 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout:{ 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout: "snap_trimq": "[]", 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout: "snap_trimq_len": 0, 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout: "epoch": 55, 2026-02-18T00:11:57.841 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.842 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "acting_recovery_backfill": [ 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "info": { 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s0", 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "0", 2026-02-18T00:11:57.843 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'301", 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'250", 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "45'200", 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 301, 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "54", 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 54, 2026-02-18T00:11:57.844 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 54, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 54, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:11:57.845 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'301", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 920, 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 55, 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:11:52.335591+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:11:52.335591+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:11:52.335591+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:11:52.335591+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:11:27.224613+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:11:52.334059+0000", 2026-02-18T00:11:57.846 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:11:52.334059+0000", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:11:52.335591+0000", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:11:52.333108+0000", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:11:52.332961+0000", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 54, 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "45'200", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "45'200", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.847 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 200, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:11:57.848 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 1232896, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 301, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 1505, 2026-02-18T00:11:57.849 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 1, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 1, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 303, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 1, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 301, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 301, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 1204, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:11:57.850 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:11:57.851 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.852 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.853 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 300 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),4(2)", 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 1 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.854 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:11:57.855 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "peer_info": [ 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "0(3)", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s3", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "3", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'301", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'301", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "45'200", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 301, 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:11:57.856 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 54, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 54, 2026-02-18T00:11:57.857 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 54, 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'301", 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 910, 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 54, 2026-02-18T00:11:57.858 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:11:27.224613+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:11:27.845469+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:11:27.845377+0000", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 54, 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "45'200", 2026-02-18T00:11:57.859 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "45'200", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 200, 2026-02-18T00:11:57.860 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:23:04.464585+0000", 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:11:57.861 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 1232896, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 301, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 1505, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 301, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 301, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:11:57.862 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 301, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 1204, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:11:57.863 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:11:57.864 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.865 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:11:57.866 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 301 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:11:57.867 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "1(1)", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s1", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "1", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'301", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'301", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "45'200", 2026-02-18T00:11:57.868 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 301, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 54, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:11:57.869 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 54, 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 54, 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'301", 2026-02-18T00:11:57.870 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 331, 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 45, 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:11:27.224613+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:11:27.845469+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:11:27.845377+0000", 2026-02-18T00:11:57.871 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 54, 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "45'200", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "45'200", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:11:57.872 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 200, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:23:04.464585+0000", 2026-02-18T00:11:57.873 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 1232896, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 301, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 1505, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 1, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 301, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:11:57.874 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 301, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 301, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 1204, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:11:57.875 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:11:57.876 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.877 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 301 2026-02-18T00:11:57.878 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:11:57.879 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "4(2)", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s2", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "2", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'301", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'301", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "45'200", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 301, 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:11:57.880 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 54, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 54, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 54, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:11:57.881 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'301", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 331, 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 45, 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:11:27.224613+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:11:27.846611+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:11:34.124195+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:11:27.845469+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:11:27.845377+0000", 2026-02-18T00:11:57.882 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 54, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "45'200", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "45'200", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:11:22.069915+0000", 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 200, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:11:57.883 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:23:04.464585+0000", 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 1232896, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 301, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 1505, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:11:57.884 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 301, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 301, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 301, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 1204, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:11:57.885 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:11:57.886 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: 2147483647 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.887 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 301 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 55, 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.888 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_state": [ 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "name": "Started/Primary/Active", 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "enter_time": "2026-02-18T00:11:52.332983+0000", 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "might_have_unfound": [ 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "0(3)", 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "1(1)", 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "2(4)", 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: "status": "osd is down" 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.889 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "4(2)", 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_progress": { 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "backfill_targets": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "waiting_on_backfill": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill_started": "MIN", 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "backfill_info": { 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "begin": "MIN", 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "end": "MIN", 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "objects": [] 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "peer_backfill_info": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "backfills_in_flight": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "recovering": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "pg_backend": { 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_ops": [], 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: "read_ops": [] 2026-02-18T00:11:57.890 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "name": "Started", 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "enter_time": "2026-02-18T00:11:52.232556+0000" 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "scrubber": { 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "active": false, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "must_scrub": false, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "must_deep_scrub": false, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "must_repair": false, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_reg_stamp": "2026-02-19T02:45:40.563977+0000", 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "schedule": "not registered for scrubbing" 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout: "agent_state": {} 2026-02-18T00:11:57.891 INFO:tasks.workunit.client.0.trial061.stdout:} 2026-02-18T00:11:57.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:590: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:11:57.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:590: TEST_ec_backfill_unfound: grep -q obj250 2026-02-18T00:11:57.916 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:11:57.916 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: jq .available_might_have_unfound 2026-02-18T00:11:57.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: check=true 2026-02-18T00:11:57.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: test true == true 2026-02-18T00:11:57.981 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:11:57.981 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].status' 2026-02-18T00:11:58.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: eval 'check="osd' is 'down"' 2026-02-18T00:11:58.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: check='osd is down' 2026-02-18T00:11:58.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:596: TEST_ec_backfill_unfound: test 'osd is down' == 'osd is down' 2026-02-18T00:11:58.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:11:58.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].osd' 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: eval 'check="2(4)"' 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: check='2(4)' 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:599: TEST_ec_backfill_unfound: test '2(4)' == '2(4)' 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:601: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:11:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:11:58.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:11:58.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:11:58.121 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:11:58.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:11:58.122 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:11:58.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:11:58.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:11:58.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:11:58.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:11:58.134 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:58.131+0000 7f6783c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:58.135 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:58.133+0000 7f6783c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:58.136 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:58.134+0000 7f6783c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:11:58.270 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:58.267+0000 7f6783c0c900 -1 Falling back to public interface 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:11:58.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:58.344 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:11:58.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:11:58.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:58.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:58.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:11:58.606 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:11:58.604+0000 7f6783c0c900 -1 osd.2 53 log_to_monitors true 2026-02-18T00:11:59.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:11:59.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:11:59.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:11:59.569 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:11:59.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:11:59.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:11:59.793 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 57 up_thru 17 down_at 54 last_clean_interval [47,53) [v2:127.0.0.1:6818/1650718167,v1:127.0.0.1:6819/1650718167] [v2:127.0.0.1:6820/1650718167,v1:127.0.0.1:6821/1650718167] exists,up 87d075a0-aa0d-41bc-8538-eb5ba3c1b240 2026-02-18T00:11:59.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:11:59.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:11:59.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:11:59.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:604: TEST_ec_backfill_unfound: timeout 5 rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-18T00:12:04.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:605: TEST_ec_backfill_unfound: test 124 = 124 2026-02-18T00:12:04.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:607: TEST_ec_backfill_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-18T00:12:04.860 INFO:tasks.workunit.client.0.trial061.stderr:pg has no unfound objects 2026-02-18T00:12:04.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:609: TEST_ec_backfill_unfound: wait_for_clean 2026-02-18T00:12:04.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:12:04.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:12:04.867 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:12:04.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:12:04.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:12:04.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:12:04.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:12:04.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:12:04.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:12:05.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:12:05.174 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:12:05.174 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:12:05.174 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:12:05.175 INFO:tasks.workunit.client.0.trial061.stderr:4' 2026-02-18T00:12:05.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:12:05.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:05.175 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:12:05.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803791 2026-02-18T00:12:05.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803791 2026-02-18T00:12:05.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791' 2026-02-18T00:12:05.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:05.241 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:12:05.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607567 2026-02-18T00:12:05.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607567 2026-02-18T00:12:05.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-51539607567' 2026-02-18T00:12:05.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:05.305 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:12:05.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135876 2026-02-18T00:12:05.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135876 2026-02-18T00:12:05.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-51539607567 2-244813135876' 2026-02-18T00:12:05.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:05.370 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:12:05.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182414 2026-02-18T00:12:05.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182414 2026-02-18T00:12:05.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-51539607567 2-244813135876 3-107374182414' 2026-02-18T00:12:05.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:05.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888077 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888077 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-51539607567 2-244813135876 3-107374182414 4-146028888077' 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803791 2026-02-18T00:12:05.500 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:05.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:12:05.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803791 2026-02-18T00:12:05.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:05.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803791 2026-02-18T00:12:05.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803791' 2026-02-18T00:12:05.503 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803791 2026-02-18T00:12:05.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:05.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803789 -lt 25769803791 2026-02-18T00:12:05.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:12:06.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:12:06.729 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:06.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803791 2026-02-18T00:12:06.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:06.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607567 2026-02-18T00:12:06.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:06.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:12:06.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607567 2026-02-18T00:12:06.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:06.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607567 2026-02-18T00:12:06.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607567' 2026-02-18T00:12:06.957 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607567 2026-02-18T00:12:06.957 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:12:07.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607567 -lt 51539607567 2026-02-18T00:12:07.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:07.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-244813135876 2026-02-18T00:12:07.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:07.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:12:07.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-244813135876 2026-02-18T00:12:07.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:07.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=244813135876 2026-02-18T00:12:07.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 244813135876' 2026-02-18T00:12:07.188 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 244813135876 2026-02-18T00:12:07.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:12:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 244813135876 -lt 244813135876 2026-02-18T00:12:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:07.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182414 2026-02-18T00:12:07.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:07.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:12:07.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182414 2026-02-18T00:12:07.411 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:07.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182414 2026-02-18T00:12:07.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182414' 2026-02-18T00:12:07.413 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182414 2026-02-18T00:12:07.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:12:07.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182414 -lt 107374182414 2026-02-18T00:12:07.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:07.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888077 2026-02-18T00:12:07.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:07.639 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:12:07.639 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888077 2026-02-18T00:12:07.640 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:07.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888077 2026-02-18T00:12:07.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888077' 2026-02-18T00:12:07.641 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888077 2026-02-18T00:12:07.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:12:07.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888078 -lt 146028888077 2026-02-18T00:12:07.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:12:07.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:07.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:12:08.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:12:08.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:12:08.428 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:12:08.428 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:08.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:12:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:12:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:12:08.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: seq 1 300 2026-02-18T00:12:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj1 = obj250 ']' 2026-02-18T00:12:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj2 = obj250 ']' 2026-02-18T00:12:08.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj3 = obj250 ']' 2026-02-18T00:12:08.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj4 = obj250 ']' 2026-02-18T00:12:08.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj5 = obj250 ']' 2026-02-18T00:12:08.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj6 = obj250 ']' 2026-02-18T00:12:08.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.850 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.850 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj7 = obj250 ']' 2026-02-18T00:12:08.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj8 = obj250 ']' 2026-02-18T00:12:08.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj9 = obj250 ']' 2026-02-18T00:12:08.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj10 = obj250 ']' 2026-02-18T00:12:08.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj11 = obj250 ']' 2026-02-18T00:12:08.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj12 = obj250 ']' 2026-02-18T00:12:08.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj13 = obj250 ']' 2026-02-18T00:12:08.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:08.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:08.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj14 = obj250 ']' 2026-02-18T00:12:08.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-18T00:12:08.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj15 = obj250 ']' 2026-02-18T00:12:09.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj16 = obj250 ']' 2026-02-18T00:12:09.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj17 = obj250 ']' 2026-02-18T00:12:09.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj18 = obj250 ']' 2026-02-18T00:12:09.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj19 = obj250 ']' 2026-02-18T00:12:09.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj20 = obj250 ']' 2026-02-18T00:12:09.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj21 = obj250 ']' 2026-02-18T00:12:09.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj22 = obj250 ']' 2026-02-18T00:12:09.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj23 = obj250 ']' 2026-02-18T00:12:09.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj24 = obj250 ']' 2026-02-18T00:12:09.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj25 = obj250 ']' 2026-02-18T00:12:09.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj26 = obj250 ']' 2026-02-18T00:12:09.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj27 = obj250 ']' 2026-02-18T00:12:09.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj28 = obj250 ']' 2026-02-18T00:12:09.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj29 = obj250 ']' 2026-02-18T00:12:09.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj30 = obj250 ']' 2026-02-18T00:12:09.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj31 = obj250 ']' 2026-02-18T00:12:09.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj32 = obj250 ']' 2026-02-18T00:12:09.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj33 = obj250 ']' 2026-02-18T00:12:09.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj34 = obj250 ']' 2026-02-18T00:12:09.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj35 = obj250 ']' 2026-02-18T00:12:09.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj36 = obj250 ']' 2026-02-18T00:12:09.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj37 = obj250 ']' 2026-02-18T00:12:09.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj38 = obj250 ']' 2026-02-18T00:12:09.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj39 = obj250 ']' 2026-02-18T00:12:09.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj40 = obj250 ']' 2026-02-18T00:12:09.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj41 = obj250 ']' 2026-02-18T00:12:09.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj42 = obj250 ']' 2026-02-18T00:12:09.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj43 = obj250 ']' 2026-02-18T00:12:09.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj44 = obj250 ']' 2026-02-18T00:12:09.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj45 = obj250 ']' 2026-02-18T00:12:09.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj46 = obj250 ']' 2026-02-18T00:12:09.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj47 = obj250 ']' 2026-02-18T00:12:09.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj48 = obj250 ']' 2026-02-18T00:12:09.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj49 = obj250 ']' 2026-02-18T00:12:09.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj50 = obj250 ']' 2026-02-18T00:12:09.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj51 = obj250 ']' 2026-02-18T00:12:09.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj52 = obj250 ']' 2026-02-18T00:12:09.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj53 = obj250 ']' 2026-02-18T00:12:09.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj54 = obj250 ']' 2026-02-18T00:12:09.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj55 = obj250 ']' 2026-02-18T00:12:09.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj56 = obj250 ']' 2026-02-18T00:12:09.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj57 = obj250 ']' 2026-02-18T00:12:09.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj58 = obj250 ']' 2026-02-18T00:12:09.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj59 = obj250 ']' 2026-02-18T00:12:09.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.843 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.844 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.844 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj60 = obj250 ']' 2026-02-18T00:12:09.844 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.863 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj61 = obj250 ']' 2026-02-18T00:12:09.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj62 = obj250 ']' 2026-02-18T00:12:09.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj63 = obj250 ']' 2026-02-18T00:12:09.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj64 = obj250 ']' 2026-02-18T00:12:09.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj65 = obj250 ']' 2026-02-18T00:12:09.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj66 = obj250 ']' 2026-02-18T00:12:09.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj67 = obj250 ']' 2026-02-18T00:12:09.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-18T00:12:09.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:09.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:09.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj68 = obj250 ']' 2026-02-18T00:12:09.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj69 = obj250 ']' 2026-02-18T00:12:10.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj70 = obj250 ']' 2026-02-18T00:12:10.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj71 = obj250 ']' 2026-02-18T00:12:10.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj72 = obj250 ']' 2026-02-18T00:12:10.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj73 = obj250 ']' 2026-02-18T00:12:10.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj74 = obj250 ']' 2026-02-18T00:12:10.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj75 = obj250 ']' 2026-02-18T00:12:10.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj76 = obj250 ']' 2026-02-18T00:12:10.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj77 = obj250 ']' 2026-02-18T00:12:10.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj78 = obj250 ']' 2026-02-18T00:12:10.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj79 = obj250 ']' 2026-02-18T00:12:10.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj80 = obj250 ']' 2026-02-18T00:12:10.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj81 = obj250 ']' 2026-02-18T00:12:10.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj82 = obj250 ']' 2026-02-18T00:12:10.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj83 = obj250 ']' 2026-02-18T00:12:10.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj84 = obj250 ']' 2026-02-18T00:12:10.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj85 = obj250 ']' 2026-02-18T00:12:10.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj86 = obj250 ']' 2026-02-18T00:12:10.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj87 = obj250 ']' 2026-02-18T00:12:10.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj88 = obj250 ']' 2026-02-18T00:12:10.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj89 = obj250 ']' 2026-02-18T00:12:10.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj90 = obj250 ']' 2026-02-18T00:12:10.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj91 = obj250 ']' 2026-02-18T00:12:10.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj92 = obj250 ']' 2026-02-18T00:12:10.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj93 = obj250 ']' 2026-02-18T00:12:10.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj94 = obj250 ']' 2026-02-18T00:12:10.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj95 = obj250 ']' 2026-02-18T00:12:10.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj96 = obj250 ']' 2026-02-18T00:12:10.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj97 = obj250 ']' 2026-02-18T00:12:10.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj98 = obj250 ']' 2026-02-18T00:12:10.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj99 = obj250 ']' 2026-02-18T00:12:10.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj100 = obj250 ']' 2026-02-18T00:12:10.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj101 = obj250 ']' 2026-02-18T00:12:10.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj101 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj102 = obj250 ']' 2026-02-18T00:12:10.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj102 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj103 = obj250 ']' 2026-02-18T00:12:10.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj103 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj104 = obj250 ']' 2026-02-18T00:12:10.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj104 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj105 = obj250 ']' 2026-02-18T00:12:10.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj105 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj106 = obj250 ']' 2026-02-18T00:12:10.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj106 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj107 = obj250 ']' 2026-02-18T00:12:10.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj107 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj108 = obj250 ']' 2026-02-18T00:12:10.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj108 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj109 = obj250 ']' 2026-02-18T00:12:10.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj109 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj110 = obj250 ']' 2026-02-18T00:12:10.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj110 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj111 = obj250 ']' 2026-02-18T00:12:10.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj111 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj112 = obj250 ']' 2026-02-18T00:12:10.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj112 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.835 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.835 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj113 = obj250 ']' 2026-02-18T00:12:10.835 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj113 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj114 = obj250 ']' 2026-02-18T00:12:10.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj114 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.870 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj115 = obj250 ']' 2026-02-18T00:12:10.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj115 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj116 = obj250 ']' 2026-02-18T00:12:10.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj116 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj117 = obj250 ']' 2026-02-18T00:12:10.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj117 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj118 = obj250 ']' 2026-02-18T00:12:10.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj118 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj119 = obj250 ']' 2026-02-18T00:12:10.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj119 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj120 = obj250 ']' 2026-02-18T00:12:10.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj120 td/test-erasure-eio/CHECK 2026-02-18T00:12:10.981 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:10.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:10.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj121 = obj250 ']' 2026-02-18T00:12:10.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj121 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj122 = obj250 ']' 2026-02-18T00:12:11.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj122 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj123 = obj250 ']' 2026-02-18T00:12:11.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj123 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj124 = obj250 ']' 2026-02-18T00:12:11.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj124 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj125 = obj250 ']' 2026-02-18T00:12:11.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj125 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj126 = obj250 ']' 2026-02-18T00:12:11.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj126 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj127 = obj250 ']' 2026-02-18T00:12:11.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj127 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj128 = obj250 ']' 2026-02-18T00:12:11.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj128 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj129 = obj250 ']' 2026-02-18T00:12:11.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj129 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj130 = obj250 ']' 2026-02-18T00:12:11.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj130 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj131 = obj250 ']' 2026-02-18T00:12:11.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj131 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj132 = obj250 ']' 2026-02-18T00:12:11.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj132 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj133 = obj250 ']' 2026-02-18T00:12:11.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj133 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj134 = obj250 ']' 2026-02-18T00:12:11.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj134 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj135 = obj250 ']' 2026-02-18T00:12:11.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj135 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj136 = obj250 ']' 2026-02-18T00:12:11.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj136 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj137 = obj250 ']' 2026-02-18T00:12:11.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj137 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj138 = obj250 ']' 2026-02-18T00:12:11.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj138 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj139 = obj250 ']' 2026-02-18T00:12:11.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj139 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.336 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj140 = obj250 ']' 2026-02-18T00:12:11.336 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj140 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj141 = obj250 ']' 2026-02-18T00:12:11.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj141 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj142 = obj250 ']' 2026-02-18T00:12:11.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj142 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj143 = obj250 ']' 2026-02-18T00:12:11.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj143 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj144 = obj250 ']' 2026-02-18T00:12:11.411 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj144 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj145 = obj250 ']' 2026-02-18T00:12:11.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj145 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj146 = obj250 ']' 2026-02-18T00:12:11.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj146 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj147 = obj250 ']' 2026-02-18T00:12:11.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj147 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj148 = obj250 ']' 2026-02-18T00:12:11.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj148 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj149 = obj250 ']' 2026-02-18T00:12:11.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj149 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj150 = obj250 ']' 2026-02-18T00:12:11.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj150 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj151 = obj250 ']' 2026-02-18T00:12:11.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj151 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj152 = obj250 ']' 2026-02-18T00:12:11.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj152 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj153 = obj250 ']' 2026-02-18T00:12:11.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj153 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj154 = obj250 ']' 2026-02-18T00:12:11.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj154 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj155 = obj250 ']' 2026-02-18T00:12:11.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj155 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj156 = obj250 ']' 2026-02-18T00:12:11.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj156 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj157 = obj250 ']' 2026-02-18T00:12:11.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj157 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj158 = obj250 ']' 2026-02-18T00:12:11.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj158 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj159 = obj250 ']' 2026-02-18T00:12:11.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj159 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj160 = obj250 ']' 2026-02-18T00:12:11.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj160 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj161 = obj250 ']' 2026-02-18T00:12:11.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj161 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj162 = obj250 ']' 2026-02-18T00:12:11.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj162 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj163 = obj250 ']' 2026-02-18T00:12:11.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj163 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj164 = obj250 ']' 2026-02-18T00:12:11.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj164 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj165 = obj250 ']' 2026-02-18T00:12:11.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj165 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj166 = obj250 ']' 2026-02-18T00:12:11.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj166 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.843 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.843 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj167 = obj250 ']' 2026-02-18T00:12:11.843 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj167 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj168 = obj250 ']' 2026-02-18T00:12:11.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj168 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj169 = obj250 ']' 2026-02-18T00:12:11.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj169 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj170 = obj250 ']' 2026-02-18T00:12:11.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj170 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj171 = obj250 ']' 2026-02-18T00:12:11.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj171 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj172 = obj250 ']' 2026-02-18T00:12:11.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj172 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj173 = obj250 ']' 2026-02-18T00:12:11.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj173 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj174 = obj250 ']' 2026-02-18T00:12:11.971 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj174 td/test-erasure-eio/CHECK 2026-02-18T00:12:11.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:11.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:11.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj175 = obj250 ']' 2026-02-18T00:12:11.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj175 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj176 = obj250 ']' 2026-02-18T00:12:12.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj176 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj177 = obj250 ']' 2026-02-18T00:12:12.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj177 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj178 = obj250 ']' 2026-02-18T00:12:12.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj178 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj179 = obj250 ']' 2026-02-18T00:12:12.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj179 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj180 = obj250 ']' 2026-02-18T00:12:12.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj180 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj181 = obj250 ']' 2026-02-18T00:12:12.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj181 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj182 = obj250 ']' 2026-02-18T00:12:12.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj182 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj183 = obj250 ']' 2026-02-18T00:12:12.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj183 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj184 = obj250 ']' 2026-02-18T00:12:12.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj184 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj185 = obj250 ']' 2026-02-18T00:12:12.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj185 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj186 = obj250 ']' 2026-02-18T00:12:12.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj186 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj187 = obj250 ']' 2026-02-18T00:12:12.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj187 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj188 = obj250 ']' 2026-02-18T00:12:12.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj188 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj189 = obj250 ']' 2026-02-18T00:12:12.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj189 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj190 = obj250 ']' 2026-02-18T00:12:12.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj190 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj191 = obj250 ']' 2026-02-18T00:12:12.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj191 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj192 = obj250 ']' 2026-02-18T00:12:12.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj192 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj193 = obj250 ']' 2026-02-18T00:12:12.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj193 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj194 = obj250 ']' 2026-02-18T00:12:12.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj194 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj195 = obj250 ']' 2026-02-18T00:12:12.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj195 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj196 = obj250 ']' 2026-02-18T00:12:12.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj196 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj197 = obj250 ']' 2026-02-18T00:12:12.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj197 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj198 = obj250 ']' 2026-02-18T00:12:12.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj198 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj199 = obj250 ']' 2026-02-18T00:12:12.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj199 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj200 = obj250 ']' 2026-02-18T00:12:12.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj200 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj201 = obj250 ']' 2026-02-18T00:12:12.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj201 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj202 = obj250 ']' 2026-02-18T00:12:12.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj202 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj203 = obj250 ']' 2026-02-18T00:12:12.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj203 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj204 = obj250 ']' 2026-02-18T00:12:12.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj204 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj205 = obj250 ']' 2026-02-18T00:12:12.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj205 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj206 = obj250 ']' 2026-02-18T00:12:12.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj206 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj207 = obj250 ']' 2026-02-18T00:12:12.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj207 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj208 = obj250 ']' 2026-02-18T00:12:12.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj208 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj209 = obj250 ']' 2026-02-18T00:12:12.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj209 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj210 = obj250 ']' 2026-02-18T00:12:12.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj210 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj211 = obj250 ']' 2026-02-18T00:12:12.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj211 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj212 = obj250 ']' 2026-02-18T00:12:12.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj212 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj213 = obj250 ']' 2026-02-18T00:12:12.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj213 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj214 = obj250 ']' 2026-02-18T00:12:12.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj214 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj215 = obj250 ']' 2026-02-18T00:12:12.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj215 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.757 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj216 = obj250 ']' 2026-02-18T00:12:12.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj216 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj217 = obj250 ']' 2026-02-18T00:12:12.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj217 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj218 = obj250 ']' 2026-02-18T00:12:12.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj218 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj219 = obj250 ']' 2026-02-18T00:12:12.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj219 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.833 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj220 = obj250 ']' 2026-02-18T00:12:12.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj220 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj221 = obj250 ']' 2026-02-18T00:12:12.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj221 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj222 = obj250 ']' 2026-02-18T00:12:12.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj222 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj223 = obj250 ']' 2026-02-18T00:12:12.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj223 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.908 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj224 = obj250 ']' 2026-02-18T00:12:12.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj224 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj225 = obj250 ']' 2026-02-18T00:12:12.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj225 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj226 = obj250 ']' 2026-02-18T00:12:12.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj226 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj227 = obj250 ']' 2026-02-18T00:12:12.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj227 td/test-erasure-eio/CHECK 2026-02-18T00:12:12.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:12.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:12.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj228 = obj250 ']' 2026-02-18T00:12:12.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj228 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj229 = obj250 ']' 2026-02-18T00:12:13.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj229 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj230 = obj250 ']' 2026-02-18T00:12:13.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj230 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj231 = obj250 ']' 2026-02-18T00:12:13.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj231 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj232 = obj250 ']' 2026-02-18T00:12:13.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj232 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.076 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj233 = obj250 ']' 2026-02-18T00:12:13.077 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj233 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj234 = obj250 ']' 2026-02-18T00:12:13.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj234 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj235 = obj250 ']' 2026-02-18T00:12:13.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj235 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.135 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.135 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj236 = obj250 ']' 2026-02-18T00:12:13.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj236 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj237 = obj250 ']' 2026-02-18T00:12:13.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj237 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj238 = obj250 ']' 2026-02-18T00:12:13.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj238 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj239 = obj250 ']' 2026-02-18T00:12:13.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj239 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj240 = obj250 ']' 2026-02-18T00:12:13.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj240 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj241 = obj250 ']' 2026-02-18T00:12:13.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj241 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj242 = obj250 ']' 2026-02-18T00:12:13.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj242 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj243 = obj250 ']' 2026-02-18T00:12:13.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj243 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj244 = obj250 ']' 2026-02-18T00:12:13.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj244 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj245 = obj250 ']' 2026-02-18T00:12:13.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj245 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj246 = obj250 ']' 2026-02-18T00:12:13.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj246 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj247 = obj250 ']' 2026-02-18T00:12:13.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj247 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj248 = obj250 ']' 2026-02-18T00:12:13.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj248 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj249 = obj250 ']' 2026-02-18T00:12:13.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj249 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj250 = obj250 ']' 2026-02-18T00:12:13.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:615: TEST_ec_backfill_unfound: rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.411 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj250: (2) No such file or directory 2026-02-18T00:12:13.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj251 = obj250 ']' 2026-02-18T00:12:13.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj251 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj252 = obj250 ']' 2026-02-18T00:12:13.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj252 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj253 = obj250 ']' 2026-02-18T00:12:13.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj253 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj254 = obj250 ']' 2026-02-18T00:12:13.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj254 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj255 = obj250 ']' 2026-02-18T00:12:13.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj255 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj256 = obj250 ']' 2026-02-18T00:12:13.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj256 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj257 = obj250 ']' 2026-02-18T00:12:13.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj257 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj258 = obj250 ']' 2026-02-18T00:12:13.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj258 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj259 = obj250 ']' 2026-02-18T00:12:13.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj259 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj260 = obj250 ']' 2026-02-18T00:12:13.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj260 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj261 = obj250 ']' 2026-02-18T00:12:13.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj261 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj262 = obj250 ']' 2026-02-18T00:12:13.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj262 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj263 = obj250 ']' 2026-02-18T00:12:13.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj263 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj264 = obj250 ']' 2026-02-18T00:12:13.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj264 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj265 = obj250 ']' 2026-02-18T00:12:13.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj265 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj266 = obj250 ']' 2026-02-18T00:12:13.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj266 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj267 = obj250 ']' 2026-02-18T00:12:13.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj267 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj268 = obj250 ']' 2026-02-18T00:12:13.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj268 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj269 = obj250 ']' 2026-02-18T00:12:13.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj269 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj270 = obj250 ']' 2026-02-18T00:12:13.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj270 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj271 = obj250 ']' 2026-02-18T00:12:13.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj271 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj272 = obj250 ']' 2026-02-18T00:12:13.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj272 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj273 = obj250 ']' 2026-02-18T00:12:13.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj273 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj274 = obj250 ']' 2026-02-18T00:12:13.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj274 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj275 = obj250 ']' 2026-02-18T00:12:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj275 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj276 = obj250 ']' 2026-02-18T00:12:13.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj276 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj277 = obj250 ']' 2026-02-18T00:12:13.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj277 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj278 = obj250 ']' 2026-02-18T00:12:13.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj278 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj279 = obj250 ']' 2026-02-18T00:12:13.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj279 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj280 = obj250 ']' 2026-02-18T00:12:13.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj280 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj281 = obj250 ']' 2026-02-18T00:12:13.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj281 td/test-erasure-eio/CHECK 2026-02-18T00:12:13.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:13.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:13.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj282 = obj250 ']' 2026-02-18T00:12:13.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj282 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj283 = obj250 ']' 2026-02-18T00:12:14.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj283 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj284 = obj250 ']' 2026-02-18T00:12:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj284 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj285 = obj250 ']' 2026-02-18T00:12:14.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj285 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj286 = obj250 ']' 2026-02-18T00:12:14.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj286 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj287 = obj250 ']' 2026-02-18T00:12:14.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj287 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj288 = obj250 ']' 2026-02-18T00:12:14.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj288 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj289 = obj250 ']' 2026-02-18T00:12:14.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj289 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj290 = obj250 ']' 2026-02-18T00:12:14.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj290 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.159 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.160 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj291 = obj250 ']' 2026-02-18T00:12:14.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj291 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj292 = obj250 ']' 2026-02-18T00:12:14.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj292 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj293 = obj250 ']' 2026-02-18T00:12:14.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj293 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.215 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj294 = obj250 ']' 2026-02-18T00:12:14.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj294 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj295 = obj250 ']' 2026-02-18T00:12:14.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj295 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj296 = obj250 ']' 2026-02-18T00:12:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj296 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj297 = obj250 ']' 2026-02-18T00:12:14.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj297 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj298 = obj250 ']' 2026-02-18T00:12:14.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj298 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj299 = obj250 ']' 2026-02-18T00:12:14.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj299 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj300 = obj250 ']' 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj300 td/test-erasure-eio/CHECK 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:622: TEST_ec_backfill_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:12:14.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:624: TEST_ec_backfill_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:12:14.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:12:14.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:12:14.618 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:12:14.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:12:14.923 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:12:14.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:12:14.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:12:14.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:12:14.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:12:14.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:12:14.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:12:14.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:12:14.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:12:14.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:12:15.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:12:15.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:12:15.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:12:15.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:12:15.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:12:15.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:12:15.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:12:15.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:15.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:12:15.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:12:15.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:15.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:12:15.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:12:15.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:12:15.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:12:15.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:12:15.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:12:15.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:12:15.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:12:15.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:12:15.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:12:15.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:12:15.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:12:15.086 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:12:15.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:12:15.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:12:15.087 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:12:15.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:15.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:12:15.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:12:15.089 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:15.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:12:15.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:12:15.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:12:15.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:12:15.092 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.092 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:12:15.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:12:15.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:12:15.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:12:15.094 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:12:15.094 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.094 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:12:15.095 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:12:15.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:12:15.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:12:15.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:12:15.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:12:15.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:12:15.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:12:15.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:15.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:15.117 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:15.117 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.117 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.117 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:15.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:12:15.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:15.144 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:15.145 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:15.145 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.145 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.146 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:15.146 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:12:15.146 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:12:15.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:12:15.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:12:15.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:12:15.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:12:15.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:12:15.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:12:15.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:15.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:15.340 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:12:15.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:12:15.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:12:15.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:12:15.452 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:12:15.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:12:16.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:12:16.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:12:16.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:12:16.503 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:12:16.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:12:16.509 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:12:15.133+0000 7fefb06d9d80 0 load: jerasure load: lrc 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_object_attr_read_error td/test-erasure-eio 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:379: TEST_ec_object_attr_read_error: local dir=td/test-erasure-eio 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:380: TEST_ec_object_attr_read_error: local objname=myobject 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:382: TEST_ec_object_attr_read_error: setup_osds 7 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-18T00:12:16.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:12:16.511 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-18T00:12:16.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:16.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:16.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:16.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:12:16.518 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:16.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f0414d95-a916-47c1-85bb-ff98b38d563a 2026-02-18T00:12:16.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f0414d95-a916-47c1-85bb-ff98b38d563a' 2026-02-18T00:12:16.518 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 f0414d95-a916-47c1-85bb-ff98b38d563a 2026-02-18T00:12:16.518 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:16.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDgA5VpaXonHxAA0p3lLBfmryGKBjIRouzw4w== 2026-02-18T00:12:16.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDgA5VpaXonHxAA0p3lLBfmryGKBjIRouzw4w=="}' 2026-02-18T00:12:16.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f0414d95-a916-47c1-85bb-ff98b38d563a -i td/test-erasure-eio/0/new.json 2026-02-18T00:12:16.627 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:16.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:12:16.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgA5VpaXonHxAA0p3lLBfmryGKBjIRouzw4w== --osd-uuid f0414d95-a916-47c1-85bb-ff98b38d563a 2026-02-18T00:12:16.652 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:16.651+0000 7f508800c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:16.654 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:16.652+0000 7f508800c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:16.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:16.653+0000 7f508800c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:16.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:16.653+0000 7f508800c900 -1 bdev(0x55d295bc6c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:16.655 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:16.654+0000 7f508800c900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:12:17.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:12:17.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:17.107 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:12:17.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:12:17.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:17.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:12:17.211 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:12:17.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:17.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:17.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:17.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:17.228 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:17.226+0000 7f3a2560f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:17.230 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:17.228+0000 7f3a2560f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:17.231 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:17.229+0000 7f3a2560f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:17.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:17.308 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:17.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:17.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:17.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:12:17.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:17.439 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:17.437+0000 7f3a2560f900 -1 Falling back to public interface 2026-02-18T00:12:17.693 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:17.691+0000 7f3a2560f900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:12:18.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:18.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:18.407 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:18.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:18.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:18.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:12:18.630 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1683205721,v1:127.0.0.1:6803/1683205721] [v2:127.0.0.1:6804/1683205721,v1:127.0.0.1:6805/1683205721] exists,up f0414d95-a916-47c1-85bb-ff98b38d563a 2026-02-18T00:12:18.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:18.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:18.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:18.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:18.667 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:18.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:12:18.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:18.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=109d13b9-3f86-42f2-b401-235b41163305 2026-02-18T00:12:18.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 109d13b9-3f86-42f2-b401-235b41163305' 2026-02-18T00:12:18.670 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 109d13b9-3f86-42f2-b401-235b41163305 2026-02-18T00:12:18.670 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:18.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDiA5Vpm9V1JhAAMc+UNbT5jH2rRY9Q3nTwYA== 2026-02-18T00:12:18.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDiA5Vpm9V1JhAAMc+UNbT5jH2rRY9Q3nTwYA=="}' 2026-02-18T00:12:18.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 109d13b9-3f86-42f2-b401-235b41163305 -i td/test-erasure-eio/1/new.json 2026-02-18T00:12:18.875 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:18.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:12:18.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiA5Vpm9V1JhAAMc+UNbT5jH2rRY9Q3nTwYA== --osd-uuid 109d13b9-3f86-42f2-b401-235b41163305 2026-02-18T00:12:18.902 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:18.900+0000 7fb96ad97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:18.903 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:18.901+0000 7fb96ad97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:18.904 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:18.902+0000 7fb96ad97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:18.905 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:18.902+0000 7fb96ad97900 -1 bdev(0x558bdd562c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:18.905 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:18.902+0000 7fb96ad97900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:12:19.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:12:19.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:19.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:12:19.229 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:12:19.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:19.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:12:19.543 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:12:19.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:19.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:19.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:19.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:19.559 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:19.556+0000 7f805ead9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:19.560 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:19.558+0000 7f805ead9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:19.561 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:19.559+0000 7f805ead9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:19.729 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:19.727+0000 7f805ead9900 -1 Falling back to public interface 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:19.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:19.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:19.768 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:19.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:19.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:12:19.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:20.084 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:20.081+0000 7f805ead9900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:12:20.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:20.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:20.995 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:20.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:20.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:20.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:12:21.219 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/434951446,v1:127.0.0.1:6811/434951446] [v2:127.0.0.1:6812/434951446,v1:127.0.0.1:6813/434951446] exists,up 109d13b9-3f86-42f2-b401-235b41163305 2026-02-18T00:12:21.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:21.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:21.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:21.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:21.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:21.226 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:21.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:21.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:12:21.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:21.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f399e61d-fa9f-4787-8392-069c6a7fa5f9 2026-02-18T00:12:21.228 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 f399e61d-fa9f-4787-8392-069c6a7fa5f9 2026-02-18T00:12:21.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f399e61d-fa9f-4787-8392-069c6a7fa5f9' 2026-02-18T00:12:21.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:21.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlA5Vp2KzVDRAAgW41zRT2FJcjTijH0muEgQ== 2026-02-18T00:12:21.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlA5Vp2KzVDRAAgW41zRT2FJcjTijH0muEgQ=="}' 2026-02-18T00:12:21.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f399e61d-fa9f-4787-8392-069c6a7fa5f9 -i td/test-erasure-eio/2/new.json 2026-02-18T00:12:21.462 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:12:21.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:12:21.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlA5Vp2KzVDRAAgW41zRT2FJcjTijH0muEgQ== --osd-uuid f399e61d-fa9f-4787-8392-069c6a7fa5f9 2026-02-18T00:12:21.489 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:21.487+0000 7f4db535d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:21.491 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:21.489+0000 7f4db535d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:21.492 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:21.490+0000 7f4db535d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:21.492 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:21.490+0000 7f4db535d900 -1 bdev(0x55a1c47a0c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:21.492 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:21.490+0000 7f4db535d900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:12:21.836 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:12:21.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:21.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:12:21.838 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:12:21.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:22.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:12:22.149 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:12:22.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:22.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:22.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:22.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:22.165 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:22.163+0000 7fdb30193900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:22.167 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:22.165+0000 7fdb30193900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:22.168 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:22.166+0000 7fdb30193900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:22.320 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:22.318+0000 7fdb30193900 -1 Falling back to public interface 2026-02-18T00:12:22.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:12:22.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:22.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:12:22.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:22.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:22.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:22.375 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:22.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:22.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:22.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:12:22.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:22.657 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:22.655+0000 7fdb30193900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:12:23.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:23.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:23.597 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:23.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:23.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:23.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:12:23.822 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2588869611,v1:127.0.0.1:6819/2588869611] [v2:127.0.0.1:6820/2588869611,v1:127.0.0.1:6821/2588869611] exists,up f399e61d-fa9f-4787-8392-069c6a7fa5f9 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:23.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=53b992fe-6f0b-415d-9d51-7553d43de00d 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 53b992fe-6f0b-415d-9d51-7553d43de00d' 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 53b992fe-6f0b-415d-9d51-7553d43de00d 2026-02-18T00:12:23.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:23.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnA5VpuazaMRAAaTyPeAdo/ogHnuW399TvOg== 2026-02-18T00:12:23.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnA5VpuazaMRAAaTyPeAdo/ogHnuW399TvOg=="}' 2026-02-18T00:12:23.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 53b992fe-6f0b-415d-9d51-7553d43de00d -i td/test-erasure-eio/3/new.json 2026-02-18T00:12:24.064 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:12:24.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:12:24.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnA5VpuazaMRAAaTyPeAdo/ogHnuW399TvOg== --osd-uuid 53b992fe-6f0b-415d-9d51-7553d43de00d 2026-02-18T00:12:24.091 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.089+0000 7f567a0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.093 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.091+0000 7f567a0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.094 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.092+0000 7f567a0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.094 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.092+0000 7f567a0d7900 -1 bdev(0x55a3b0820c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:24.094 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.092+0000 7f567a0d7900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:12:24.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:12:24.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:24.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:12:24.436 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:12:24.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:24.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:24.768 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.766+0000 7f81918f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.769 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.768+0000 7f81918f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.770 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.769+0000 7f81918f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:24.901 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:24.899+0000 7f81918f8900 -1 Falling back to public interface 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:24.983 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:24.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:24.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:12:25.193 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:25.190+0000 7f81918f8900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:12:25.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:26.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:26.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:26.211 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:26.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:26.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:26.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:12:26.434 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3315271386,v1:127.0.0.1:6827/3315271386] [v2:127.0.0.1:6828/3315271386,v1:127.0.0.1:6829/3315271386] exists,up 53b992fe-6f0b-415d-9d51-7553d43de00d 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:26.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d8569513-8c37-4543-bfdd-7931f6bd5128 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 d8569513-8c37-4543-bfdd-7931f6bd5128' 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 d8569513-8c37-4543-bfdd-7931f6bd5128 2026-02-18T00:12:26.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:26.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDqA5Vpv4WlGhAAq5E9Cr3ulBJg1WUuQB0cxg== 2026-02-18T00:12:26.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDqA5Vpv4WlGhAAq5E9Cr3ulBJg1WUuQB0cxg=="}' 2026-02-18T00:12:26.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d8569513-8c37-4543-bfdd-7931f6bd5128 -i td/test-erasure-eio/4/new.json 2026-02-18T00:12:26.686 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:12:26.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:12:26.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDqA5Vpv4WlGhAAq5E9Cr3ulBJg1WUuQB0cxg== --osd-uuid d8569513-8c37-4543-bfdd-7931f6bd5128 2026-02-18T00:12:26.713 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:26.711+0000 7f6e9576b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:26.714 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:26.712+0000 7f6e9576b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:26.715 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:26.713+0000 7f6e9576b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:26.715 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:26.714+0000 7f6e9576b900 -1 bdev(0x556175de2c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:26.716 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:26.714+0000 7f6e9576b900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:12:27.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:12:27.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:27.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:12:27.045 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:12:27.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:27.361 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:12:27.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:12:27.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:27.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:27.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:27.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:27.378 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:27.376+0000 7f849ec0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:27.380 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:27.378+0000 7f849ec0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:27.381 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:27.379+0000 7f849ec0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:27.514 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:27.511+0000 7f849ec0e900 -1 Falling back to public interface 2026-02-18T00:12:27.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:12:27.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:27.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:12:27.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:27.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:27.588 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:27.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:27.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:27.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:27.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:12:27.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:27.865 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:27.863+0000 7f849ec0e900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:12:28.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:28.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:28.815 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:28.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:28.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:28.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:12:29.040 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 34 up_thru 35 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2819077765,v1:127.0.0.1:6835/2819077765] [v2:127.0.0.1:6836/2819077765,v1:127.0.0.1:6837/2819077765] exists,up d8569513-8c37-4543-bfdd-7931f6bd5128 2026-02-18T00:12:29.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:29.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:29.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:29.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f7450d4e-44d2-406e-ba9d-8c7a276902a4 2026-02-18T00:12:29.045 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 f7450d4e-44d2-406e-ba9d-8c7a276902a4 2026-02-18T00:12:29.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 f7450d4e-44d2-406e-ba9d-8c7a276902a4' 2026-02-18T00:12:29.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:29.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDtA5Vp3B00AxAA0N4nDnro/cFdfaSH6d9C2A== 2026-02-18T00:12:29.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDtA5Vp3B00AxAA0N4nDnro/cFdfaSH6d9C2A=="}' 2026-02-18T00:12:29.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f7450d4e-44d2-406e-ba9d-8c7a276902a4 -i td/test-erasure-eio/5/new.json 2026-02-18T00:12:29.281 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:12:29.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-18T00:12:29.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtA5Vp3B00AxAA0N4nDnro/cFdfaSH6d9C2A== --osd-uuid f7450d4e-44d2-406e-ba9d-8c7a276902a4 2026-02-18T00:12:29.308 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:29.306+0000 7f083ba10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:29.310 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:29.308+0000 7f083ba10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:29.310 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:29.308+0000 7f083ba10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:29.311 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:29.309+0000 7f083ba10900 -1 bdev(0x5568105aac00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:29.311 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:29.309+0000 7f083ba10900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-18T00:12:29.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-18T00:12:29.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:29.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:12:29.641 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:12:29.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:29.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:12:29.997 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:12:29.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:29.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:29.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:29.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:30.014 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:30.012+0000 7f2c4d21b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:30.015 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:30.014+0000 7f2c4d21b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:30.016 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:30.014+0000 7f2c4d21b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:30.154 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:30.151+0000 7f2c4d21b900 -1 Falling back to public interface 2026-02-18T00:12:30.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:30.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:12:30.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:30.480 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:30.478+0000 7f2c4d21b900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:12:31.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:31.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:31.452 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:31.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:31.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:31.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:12:31.678 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/353233115,v1:127.0.0.1:6843/353233115] [v2:127.0.0.1:6844/353233115,v1:127.0.0.1:6845/353233115] exists,up f7450d4e-44d2-406e-ba9d-8c7a276902a4 2026-02-18T00:12:31.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:31.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:31.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:31.683 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:31.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:31.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:31.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:31.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-18T00:12:31.685 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=94c49a04-505f-49d2-bff4-da5322b5da30 2026-02-18T00:12:31.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 94c49a04-505f-49d2-bff4-da5322b5da30' 2026-02-18T00:12:31.686 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 94c49a04-505f-49d2-bff4-da5322b5da30 2026-02-18T00:12:31.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:31.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDvA5Vp/ZAzKRAAXEp9NsIacM32OdGiooBVEQ== 2026-02-18T00:12:31.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDvA5Vp/ZAzKRAAXEp9NsIacM32OdGiooBVEQ=="}' 2026-02-18T00:12:31.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 94c49a04-505f-49d2-bff4-da5322b5da30 -i td/test-erasure-eio/6/new.json 2026-02-18T00:12:31.924 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:12:31.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-18T00:12:31.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvA5Vp/ZAzKRAAXEp9NsIacM32OdGiooBVEQ== --osd-uuid 94c49a04-505f-49d2-bff4-da5322b5da30 2026-02-18T00:12:31.951 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:31.949+0000 7f6db46a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:31.953 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:31.951+0000 7f6db46a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:31.954 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:31.952+0000 7f6db46a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:31.954 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:31.952+0000 7f6db46a1900 -1 bdev(0x56420889ac00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:31.954 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:31.952+0000 7f6db46a1900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-18T00:12:32.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-18T00:12:32.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:32.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:12:32.275 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:12:32.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:32.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:12:32.593 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:12:32.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:32.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:32.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:32.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:32.610 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:32.609+0000 7faa5edf4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:32.612 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:32.610+0000 7faa5edf4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:32.613 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:32.611+0000 7faa5edf4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:32.800 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:32.799+0000 7faa5edf4900 -1 Falling back to public interface 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:32.821 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:32.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:32.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:12:33.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:33.093 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:33.091+0000 7faa5edf4900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:34.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:12:34.281 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 52 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1915799724,v1:127.0.0.1:6851/1915799724] [v2:127.0.0.1:6852/1915799724,v1:127.0.0.1:6853/1915799724] exists,up 94c49a04-505f-49d2-bff4-da5322b5da30 2026-02-18T00:12:34.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:34.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:34.283 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:34.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:12:34.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:12:34.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:12:34.328 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:12:34.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:12:34.334 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:12:17.439+0000 7f3a2560f900 0 load: jerasure load: lrc 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:384: TEST_ec_object_attr_read_error: local poolname=pool-jerasure 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:385: TEST_ec_object_attr_read_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:12:34.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:12:34.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:12:34.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:12:34.969 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:12:34.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:12:35.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:12:35.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:12:35.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:12:35.980 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:12:36.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:12:36.291 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:12:36.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:12:36.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.292 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:12:36.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-18T00:12:36.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-18T00:12:36.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-18T00:12:36.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:12:36.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-18T00:12:36.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-18T00:12:36.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854' 2026-02-18T00:12:36.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.421 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:12:36.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378629 2026-02-18T00:12:36.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378629 2026-02-18T00:12:36.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629' 2026-02-18T00:12:36.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.486 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:12:36.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149702 2026-02-18T00:12:36.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149702 2026-02-18T00:12:36.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-111669149702' 2026-02-18T00:12:36.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.550 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:12:36.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888068 2026-02-18T00:12:36.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888068 2026-02-18T00:12:36.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-111669149702 4-146028888068' 2026-02-18T00:12:36.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:12:36.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626437 2026-02-18T00:12:36.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626437 2026-02-18T00:12:36.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-111669149702 4-146028888068 5-180388626437' 2026-02-18T00:12:36.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:36.679 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299395 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299395 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-111669149702 4-146028888068 5-180388626437 6-223338299395' 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-18T00:12:36.743 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:36.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:12:36.744 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-18T00:12:36.744 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:36.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-18T00:12:36.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-18T00:12:36.746 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803782 2026-02-18T00:12:36.746 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:36.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-18T00:12:36.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:12:37.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:12:37.978 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:38.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-18T00:12:38.202 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:38.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574854 2026-02-18T00:12:38.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:38.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:12:38.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574854 2026-02-18T00:12:38.204 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:38.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-18T00:12:38.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574854' 2026-02-18T00:12:38.206 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574854 2026-02-18T00:12:38.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:12:38.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-18T00:12:38.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:38.431 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378629 2026-02-18T00:12:38.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:38.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:12:38.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378629 2026-02-18T00:12:38.433 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:38.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378629 2026-02-18T00:12:38.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378629' 2026-02-18T00:12:38.434 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 81604378629 2026-02-18T00:12:38.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:12:38.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378629 -lt 81604378629 2026-02-18T00:12:38.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:38.663 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149702 2026-02-18T00:12:38.663 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:38.664 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:12:38.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149702 2026-02-18T00:12:38.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:38.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149702 2026-02-18T00:12:38.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149702' 2026-02-18T00:12:38.666 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149702 2026-02-18T00:12:38.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:12:38.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149702 -lt 111669149702 2026-02-18T00:12:38.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:38.890 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888068 2026-02-18T00:12:38.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:38.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:12:38.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888068 2026-02-18T00:12:38.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:38.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888068 2026-02-18T00:12:38.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888068' 2026-02-18T00:12:38.893 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888068 2026-02-18T00:12:38.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:12:39.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888068 -lt 146028888068 2026-02-18T00:12:39.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:39.121 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626437 2026-02-18T00:12:39.122 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:39.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:12:39.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626437 2026-02-18T00:12:39.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626437 2026-02-18T00:12:39.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626437' 2026-02-18T00:12:39.124 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 180388626437 2026-02-18T00:12:39.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:12:39.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626437 -lt 180388626437 2026-02-18T00:12:39.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:39.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-223338299395 2026-02-18T00:12:39.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:39.356 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:12:39.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-223338299395 2026-02-18T00:12:39.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:39.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=223338299395 2026-02-18T00:12:39.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 223338299395' 2026-02-18T00:12:39.358 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 223338299395 2026-02-18T00:12:39.358 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:12:39.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 223338299396 -lt 223338299395 2026-02-18T00:12:39.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:12:39.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:39.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:39.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:12:39.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:12:40.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:12:40.113 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:12:40.113 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:40.113 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:40.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:387: TEST_ec_object_attr_read_error: get_primary pool-jerasure myobject 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=pool-jerasure 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=myobject 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:12:40.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-18T00:12:40.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:387: TEST_ec_object_attr_read_error: local primary_osd=3 2026-02-18T00:12:40.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:389: TEST_ec_object_attr_read_error: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-18T00:12:40.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:12:40.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:12:40.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:12:40.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:12:40.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:392: TEST_ec_object_attr_read_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:12:40.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-18T00:12:41.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:395: TEST_ec_object_attr_read_error: inject_eio ec mdata pool-jerasure myobject td/test-erasure-eio 1 2026-02-18T00:12:41.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=mdata 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:12:41.156 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2147483647 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:12:41.384 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2147483647 5 1 0 6 2026-02-18T00:12:41.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('2147483647' '5' '1' '0' '6') 2026-02-18T00:12:41.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:12:41.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=5 2026-02-18T00:12:41.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:12:41.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/5/type 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 5 bluestore_debug_inject_read_err true 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=5 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:12:41.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.5 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.5 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.5 ']' 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.5.asok 2026-02-18T00:12:41.387 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.5.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:12:41.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:12:41.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:12:41.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.5 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.5 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.5 ']' 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.5.asok 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:12:41.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.5.asok injectmdataerr pool-jerasure myobject 1 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:398: TEST_ec_object_attr_read_error: activate_osd td/test-erasure-eio 3 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:12:41.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:12:41.489 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:12:41.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:12:41.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:12:41.490 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:12:41.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:41.490 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-18T00:12:41.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:12:41.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:12:41.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:12:41.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:12:41.508 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:41.505+0000 7fe1c8672900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:41.509 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:41.507+0000 7fe1c8672900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:41.510 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:41.508+0000 7fe1c8672900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:41.647 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:41.644+0000 7fe1c8672900 -1 Falling back to public interface 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:41.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:12:41.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:41.981 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:41.979+0000 7fe1c8672900 -1 osd.3 59 log_to_monitors true 2026-02-18T00:12:42.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:42.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:42.939 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:42.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:42.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:42.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [26,59) [v2:127.0.0.1:6826/4043915802,v1:127.0.0.1:6827/4043915802] [v2:127.0.0.1:6828/4043915802,v1:127.0.0.1:6829/4043915802] exists,up 53b992fe-6f0b-415d-9d51-7553d43de00d 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:401: TEST_ec_object_attr_read_error: wait_for_clean 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:12:43.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:12:43.165 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:12:43.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:12:43.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:12:43.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:12:43.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:12:43.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:12:43.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.475 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:12:43.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:12:43.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:12:43.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:12:43.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:12:43.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-18T00:12:43.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-18T00:12:43.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857' 2026-02-18T00:12:43.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:12:43.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378632 2026-02-18T00:12:43.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378632 2026-02-18T00:12:43.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632' 2026-02-18T00:12:43.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:12:43.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939651 2026-02-18T00:12:43.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939651 2026-02-18T00:12:43.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-270582939651' 2026-02-18T00:12:43.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:12:43.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888071 2026-02-18T00:12:43.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888071 2026-02-18T00:12:43.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-270582939651 4-146028888071' 2026-02-18T00:12:43.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:12:43.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626440 2026-02-18T00:12:43.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626440 2026-02-18T00:12:43.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-270582939651 4-146028888071 5-180388626440' 2026-02-18T00:12:43.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:12:43.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:12:43.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299398 2026-02-18T00:12:43.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299398 2026-02-18T00:12:43.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-270582939651 4-146028888071 5-180388626440 6-223338299398' 2026-02-18T00:12:43.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:43.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:12:43.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:43.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:12:43.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:12:43.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:43.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:12:43.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:12:43.927 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803785 2026-02-18T00:12:43.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:44.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-18T00:12:44.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:12:45.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:12:45.151 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-18T00:12:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:12:46.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:12:46.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:12:46.602 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803786 -lt 25769803785 2026-02-18T00:12:46.602 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:46.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574857 2026-02-18T00:12:46.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:46.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:12:46.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574857 2026-02-18T00:12:46.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:46.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-18T00:12:46.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574857' 2026-02-18T00:12:46.605 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574857 2026-02-18T00:12:46.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:12:46.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-18T00:12:46.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:46.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378632 2026-02-18T00:12:46.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:46.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:12:46.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378632 2026-02-18T00:12:46.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:46.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378632 2026-02-18T00:12:46.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378632' 2026-02-18T00:12:46.832 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 81604378632 2026-02-18T00:12:46.832 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:12:47.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378633 -lt 81604378632 2026-02-18T00:12:47.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:47.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939651 2026-02-18T00:12:47.055 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:47.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:12:47.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-270582939651 2026-02-18T00:12:47.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:47.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=270582939651 2026-02-18T00:12:47.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 270582939651' 2026-02-18T00:12:47.058 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 270582939651 2026-02-18T00:12:47.058 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:12:47.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 270582939651 -lt 270582939651 2026-02-18T00:12:47.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:47.283 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888071 2026-02-18T00:12:47.283 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:47.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:12:47.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888071 2026-02-18T00:12:47.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:47.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888071 2026-02-18T00:12:47.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888071' 2026-02-18T00:12:47.286 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888071 2026-02-18T00:12:47.286 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:12:47.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888072 -lt 146028888071 2026-02-18T00:12:47.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:47.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626440 2026-02-18T00:12:47.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:47.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:12:47.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626440 2026-02-18T00:12:47.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:47.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626440 2026-02-18T00:12:47.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626440' 2026-02-18T00:12:47.514 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 180388626440 2026-02-18T00:12:47.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:12:47.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626441 -lt 180388626440 2026-02-18T00:12:47.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:12:47.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-223338299398 2026-02-18T00:12:47.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:12:47.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:12:47.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-223338299398 2026-02-18T00:12:47.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:12:47.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=223338299398 2026-02-18T00:12:47.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 223338299398' 2026-02-18T00:12:47.741 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 223338299398 2026-02-18T00:12:47.741 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:12:47.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 223338299399 -lt 223338299398 2026-02-18T00:12:47.969 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:12:47.969 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:47.970 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:48.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:12:48.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:12:48.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:12:48.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:12:48.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:12:48.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:12:48.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:12:48.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:12:48.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:12:48.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:12:48.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:12:48.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:403: TEST_ec_object_attr_read_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-18T00:12:48.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:12:48.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:12:48.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-18T00:12:48.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:12:48.835 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:12:48.836 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:405: TEST_ec_object_attr_read_error: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:12:48.836 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:12:48.836 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:12:49.109 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:12:49.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:12:49.393 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:12:49.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:12:49.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:12:49.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:12:49.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:12:49.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:12:49.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:12:49.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:12:49.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:12:49.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:12:49.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:12:49.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:12:49.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:49.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:12:49.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:12:49.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:49.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:12:49.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:12:49.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:12:49.532 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:12:49.532 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.532 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:12:49.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:12:49.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:12:49.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:12:49.536 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:12:49.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:12:49.537 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:12:49.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:12:49.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:12:49.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:12:49.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:49.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:12:49.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:12:49.540 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:12:49.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:12:49.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:12:49.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:12:49.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:12:49.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.542 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:12:49.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:12:49.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:12:49.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:12:49.544 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:12:49.544 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:12:49.546 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:12:49.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:12:49.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:12:49.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:12:49.567 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:12:49.567 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:49.567 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:49.568 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:49.568 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.568 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.568 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:49.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:12:49.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:12:49.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:12:49.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:12:49.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:12:49.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:12:49.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:12:49.596 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:12:49.597 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:12:49.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:12:49.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:12:49.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:12:49.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:12:49.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:12:49.642 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:12:49.642 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:49.642 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:49.642 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:49.643 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.643 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.643 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:49.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:12:49.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:12:49.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:12:49.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:12:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:12:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:12:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:12:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:12:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:12:49.786 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:12:49.786 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:49.786 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:49.786 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:49.786 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:49.787 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:49.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:49.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:12:49.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:12:49.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:12:49.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:12:49.904 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:12:49.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:12:50.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:12:50.954 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:12:50.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:12:50.960 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:12:49.584+0000 7f2798a0fd80 0 load: jerasure load: lrc 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_errors td/test-erasure-eio 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:438: TEST_ec_recovery_multiple_errors: local dir=td/test-erasure-eio 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:439: TEST_ec_recovery_multiple_errors: local objname=myobject 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:441: TEST_ec_recovery_multiple_errors: setup_osds 9 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=9 2026-02-18T00:12:50.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:12:50.962 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 9 - 1 2026-02-18T00:12:50.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 8 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:50.966 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1792a7a4-b53b-447e-9ec8-21ed269a33cb 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1792a7a4-b53b-447e-9ec8-21ed269a33cb' 2026-02-18T00:12:50.967 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 1792a7a4-b53b-447e-9ec8-21ed269a33cb 2026-02-18T00:12:50.968 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:50.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQACBJVp8HwlOhAAZZlOhvXM52oqbtlinxm4kg== 2026-02-18T00:12:50.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQACBJVp8HwlOhAAZZlOhvXM52oqbtlinxm4kg=="}' 2026-02-18T00:12:50.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1792a7a4-b53b-447e-9ec8-21ed269a33cb -i td/test-erasure-eio/0/new.json 2026-02-18T00:12:51.082 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:51.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:12:51.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQACBJVp8HwlOhAAZZlOhvXM52oqbtlinxm4kg== --osd-uuid 1792a7a4-b53b-447e-9ec8-21ed269a33cb 2026-02-18T00:12:51.109 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.106+0000 7fa47bfa4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.110 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.107+0000 7fa47bfa4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.111 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.108+0000 7fa47bfa4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.111 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.108+0000 7fa47bfa4900 -1 bdev(0x55bf8d24ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:51.112 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.109+0000 7fa47bfa4900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:12:51.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:12:51.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:51.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:12:51.570 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:12:51.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:51.674 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:12:51.675 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:12:51.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:51.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:51.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:51.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:51.692 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.689+0000 7fbc0c71c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.694 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.691+0000 7fbc0c71c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.695 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.692+0000 7fbc0c71c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:12:51.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:51.890 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:51.887+0000 7fbc0c71c900 -1 Falling back to public interface 2026-02-18T00:12:52.153 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:52.150+0000 7fbc0c71c900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:12:52.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:52.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:52.876 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:52.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:52.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:52.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:12:53.100 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3332054120,v1:127.0.0.1:6803/3332054120] [v2:127.0.0.1:6804/3332054120,v1:127.0.0.1:6805/3332054120] exists,up 1792a7a4-b53b-447e-9ec8-21ed269a33cb 2026-02-18T00:12:53.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:53.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:53.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:53.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:53.102 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=85820149-8fef-4c51-bfa5-2fc7636e41a5 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 85820149-8fef-4c51-bfa5-2fc7636e41a5' 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 85820149-8fef-4c51-bfa5-2fc7636e41a5 2026-02-18T00:12:53.104 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:53.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFBJVpAwXOBhAAnf+NDMOxUhS/74UFEmiPVg== 2026-02-18T00:12:53.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFBJVpAwXOBhAAnf+NDMOxUhS/74UFEmiPVg=="}' 2026-02-18T00:12:53.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 85820149-8fef-4c51-bfa5-2fc7636e41a5 -i td/test-erasure-eio/1/new.json 2026-02-18T00:12:53.340 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:53.348 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:12:53.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFBJVpAwXOBhAAnf+NDMOxUhS/74UFEmiPVg== --osd-uuid 85820149-8fef-4c51-bfa5-2fc7636e41a5 2026-02-18T00:12:53.366 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:53.363+0000 7fe2d98ff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:53.368 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:53.365+0000 7fe2d98ff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:53.369 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:53.366+0000 7fe2d98ff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:53.369 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:53.366+0000 7fe2d98ff900 -1 bdev(0x55a12e004c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:53.369 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:53.366+0000 7fe2d98ff900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:12:53.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:12:53.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:53.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:12:53.698 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:12:53.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:54.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:12:54.018 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:12:54.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:54.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:54.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:54.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:54.036 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:54.032+0000 7fbaced83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:54.037 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:54.034+0000 7fbaced83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:54.038 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:54.035+0000 7fbaced83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:54.177 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:54.173+0000 7fbaced83900 -1 Falling back to public interface 2026-02-18T00:12:54.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:12:54.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:54.243 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:54.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:54.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:12:54.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:54.484 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:54.481+0000 7fbaced83900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:12:55.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:55.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:55.465 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:55.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:55.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:55.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:12:55.691 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2068438503,v1:127.0.0.1:6811/2068438503] [v2:127.0.0.1:6812/2068438503,v1:127.0.0.1:6813/2068438503] exists,up 85820149-8fef-4c51-bfa5-2fc7636e41a5 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:12:55.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:55.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7f07a29c-ee3d-48af-8766-0318ed049da6 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 7f07a29c-ee3d-48af-8766-0318ed049da6 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7f07a29c-ee3d-48af-8766-0318ed049da6' 2026-02-18T00:12:55.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:55.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAHBJVpASn4KRAAxJ3FnlK9elM9+KGuT/WMfw== 2026-02-18T00:12:55.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAHBJVpASn4KRAAxJ3FnlK9elM9+KGuT/WMfw=="}' 2026-02-18T00:12:55.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7f07a29c-ee3d-48af-8766-0318ed049da6 -i td/test-erasure-eio/2/new.json 2026-02-18T00:12:55.934 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:12:55.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:12:55.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAHBJVpASn4KRAAxJ3FnlK9elM9+KGuT/WMfw== --osd-uuid 7f07a29c-ee3d-48af-8766-0318ed049da6 2026-02-18T00:12:55.961 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:55.958+0000 7f99aba12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:55.962 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:55.959+0000 7f99aba12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:55.963 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:55.960+0000 7f99aba12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:55.964 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:55.961+0000 7f99aba12900 -1 bdev(0x55741da32c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:55.964 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:55.961+0000 7f99aba12900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:12:56.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:12:56.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:56.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:12:56.307 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:12:56.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:56.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:12:56.627 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:12:56.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:56.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:56.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:56.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:56.644 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:56.641+0000 7fe8d7d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:56.646 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:56.643+0000 7fe8d7d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:56.647 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:56.644+0000 7fe8d7d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:56.762 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:56.758+0000 7fe8d7d2d900 -1 Falling back to public interface 2026-02-18T00:12:56.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:12:56.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:56.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:12:56.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:56.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:56.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:56.853 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:56.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:56.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:56.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:12:57.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:57.112 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:57.109+0000 7fe8d7d2d900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:12:58.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:12:58.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:58.083 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:12:58.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:12:58.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:58.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:12:58.313 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2012266766,v1:127.0.0.1:6819/2012266766] [v2:127.0.0.1:6820/2012266766,v1:127.0.0.1:6821/2012266766] exists,up 7f07a29c-ee3d-48af-8766-0318ed049da6 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:12:58.315 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9cbd2f53-9a3f-4845-82a3-81901c130d1d 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 9cbd2f53-9a3f-4845-82a3-81901c130d1d' 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 9cbd2f53-9a3f-4845-82a3-81901c130d1d 2026-02-18T00:12:58.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:12:58.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKBJVprA15ExAA8dtyEyPnFs20YWHfnuaPdA== 2026-02-18T00:12:58.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKBJVprA15ExAA8dtyEyPnFs20YWHfnuaPdA=="}' 2026-02-18T00:12:58.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9cbd2f53-9a3f-4845-82a3-81901c130d1d -i td/test-erasure-eio/3/new.json 2026-02-18T00:12:58.562 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:12:58.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:12:58.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKBJVprA15ExAA8dtyEyPnFs20YWHfnuaPdA== --osd-uuid 9cbd2f53-9a3f-4845-82a3-81901c130d1d 2026-02-18T00:12:58.589 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:58.586+0000 7f13fbe97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:58.591 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:58.588+0000 7f13fbe97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:58.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:58.589+0000 7f13fbe97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:58.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:58.589+0000 7f13fbe97900 -1 bdev(0x55b4b580cc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:12:58.593 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:58.589+0000 7f13fbe97900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:12:58.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:12:58.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:12:58.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:12:58.927 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:12:58.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:12:59.243 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:12:59.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:12:59.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:12:59.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:12:59.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:12:59.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:12:59.261 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:59.257+0000 7ff4e641b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:59.262 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:59.259+0000 7ff4e641b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:59.263 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:59.260+0000 7ff4e641b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:12:59.438 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:59.434+0000 7ff4e641b900 -1 Falling back to public interface 2026-02-18T00:12:59.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:12:59.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:12:59.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:12:59.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:12:59.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:12:59.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:12:59.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:12:59.463 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:12:59.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:12:59.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:12:59.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:12:59.796 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:12:59.793+0000 7ff4e641b900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:13:00.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:00.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:00.687 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:00.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:00.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:00.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:13:00.910 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2247338004,v1:127.0.0.1:6827/2247338004] [v2:127.0.0.1:6828/2247338004,v1:127.0.0.1:6829/2247338004] exists,up 9cbd2f53-9a3f-4845-82a3-81901c130d1d 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:00.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:13:00.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:00.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:00.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:00.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:13:00.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:00.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=da4f8ba5-4405-4e6d-9172-59ab98eda8b8 2026-02-18T00:13:00.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 da4f8ba5-4405-4e6d-9172-59ab98eda8b8' 2026-02-18T00:13:00.919 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 da4f8ba5-4405-4e6d-9172-59ab98eda8b8 2026-02-18T00:13:00.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:00.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAMBJVpgrEQNxAAiSt7Nrv+J5CoMs8UT8q5/w== 2026-02-18T00:13:00.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAMBJVpgrEQNxAAiSt7Nrv+J5CoMs8UT8q5/w=="}' 2026-02-18T00:13:00.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new da4f8ba5-4405-4e6d-9172-59ab98eda8b8 -i td/test-erasure-eio/4/new.json 2026-02-18T00:13:01.157 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:13:01.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:13:01.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAMBJVpgrEQNxAAiSt7Nrv+J5CoMs8UT8q5/w== --osd-uuid da4f8ba5-4405-4e6d-9172-59ab98eda8b8 2026-02-18T00:13:01.184 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.181+0000 7f460cc0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:01.186 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.183+0000 7f460cc0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:01.187 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.184+0000 7f460cc0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:01.187 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.184+0000 7f460cc0e900 -1 bdev(0x563b09c90c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:01.188 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.184+0000 7f460cc0e900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:13:01.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:13:01.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:01.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:13:01.502 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:13:01.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:01.815 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:13:01.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:13:01.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:01.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:01.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:01.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:01.832 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.829+0000 7fd248964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:01.834 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.831+0000 7fd248964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:01.835 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.832+0000 7fd248964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:02.001 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:01.997+0000 7fd248964900 -1 Falling back to public interface 2026-02-18T00:13:02.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:02.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:02.043 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:02.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:02.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:13:02.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:02.360 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:02.356+0000 7fd248964900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:13:03.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:03.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:03.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:03.269 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:03.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:03.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:13:03.488 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 32 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/979372879,v1:127.0.0.1:6835/979372879] [v2:127.0.0.1:6836/979372879,v1:127.0.0.1:6837/979372879] exists,up da4f8ba5-4405-4e6d-9172-59ab98eda8b8 2026-02-18T00:13:03.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:03.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:03.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:03.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:03.495 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:03.496 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cf7f206e-702b-458b-8dac-914bf9d58dc9 2026-02-18T00:13:03.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 cf7f206e-702b-458b-8dac-914bf9d58dc9' 2026-02-18T00:13:03.498 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 cf7f206e-702b-458b-8dac-914bf9d58dc9 2026-02-18T00:13:03.498 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:03.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAPBJVpG6vrHRAA/vDHFEU78sklbnOz4Tcb4A== 2026-02-18T00:13:03.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAPBJVpG6vrHRAA/vDHFEU78sklbnOz4Tcb4A=="}' 2026-02-18T00:13:03.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cf7f206e-702b-458b-8dac-914bf9d58dc9 -i td/test-erasure-eio/5/new.json 2026-02-18T00:13:03.733 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:13:03.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-18T00:13:03.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPBJVpG6vrHRAA/vDHFEU78sklbnOz4Tcb4A== --osd-uuid cf7f206e-702b-458b-8dac-914bf9d58dc9 2026-02-18T00:13:03.759 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:03.756+0000 7f3bd680f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:03.760 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:03.757+0000 7f3bd680f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:03.761 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:03.758+0000 7f3bd680f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:03.762 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:03.758+0000 7f3bd680f900 -1 bdev(0x5644d82e4c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:03.762 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:03.759+0000 7f3bd680f900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-18T00:13:04.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-18T00:13:04.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:04.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:13:04.092 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:13:04.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:04.423 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:13:04.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:13:04.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:04.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:04.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:04.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:04.440 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:04.437+0000 7f4d9be97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:04.442 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:04.438+0000 7f4d9be97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:04.442 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:04.439+0000 7f4d9be97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:04.569 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:04.565+0000 7f4d9be97900 -1 Falling back to public interface 2026-02-18T00:13:04.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:13:04.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:04.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:13:04.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:04.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:04.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:04.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:04.649 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:04.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:04.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:13:04.868 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:04.865+0000 7f4d9be97900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:13:04.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:05.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:05.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:05.879 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:05.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:05.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:05.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:13:06.106 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2914480225,v1:127.0.0.1:6843/2914480225] [v2:127.0.0.1:6844/2914480225,v1:127.0.0.1:6845/2914480225] exists,up cf7f206e-702b-458b-8dac-914bf9d58dc9 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:06.107 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:06.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:06.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-18T00:13:06.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:06.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bc814d8e-e7a4-4eae-8994-b84986d3c571 2026-02-18T00:13:06.110 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 bc814d8e-e7a4-4eae-8994-b84986d3c571 2026-02-18T00:13:06.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 bc814d8e-e7a4-4eae-8994-b84986d3c571' 2026-02-18T00:13:06.110 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:06.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQASBJVprMohBxAA6gVxRsyWxnIYutZv/SD7bQ== 2026-02-18T00:13:06.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQASBJVprMohBxAA6gVxRsyWxnIYutZv/SD7bQ=="}' 2026-02-18T00:13:06.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bc814d8e-e7a4-4eae-8994-b84986d3c571 -i td/test-erasure-eio/6/new.json 2026-02-18T00:13:06.350 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:13:06.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-18T00:13:06.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQASBJVprMohBxAA6gVxRsyWxnIYutZv/SD7bQ== --osd-uuid bc814d8e-e7a4-4eae-8994-b84986d3c571 2026-02-18T00:13:06.377 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:06.374+0000 7f2172f77900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:06.379 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:06.376+0000 7f2172f77900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:06.380 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:06.377+0000 7f2172f77900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:06.380 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:06.377+0000 7f2172f77900 -1 bdev(0x55782b158c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:06.380 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:06.377+0000 7f2172f77900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-18T00:13:06.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-18T00:13:06.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:06.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:13:06.706 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:13:06.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:07.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:13:07.053 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:13:07.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:07.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:07.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:07.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:07.070 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:07.066+0000 7f5eb706b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:07.071 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:07.068+0000 7f5eb706b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:07.072 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:07.069+0000 7f5eb706b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:07.231 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:07.227+0000 7f5eb706b900 -1 Falling back to public interface 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:07.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:07.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:07.279 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:07.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:07.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:13:07.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:07.572 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:07.568+0000 7f5eb706b900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:13:08.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:08.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:08.509 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:08.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:08.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:08.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:13:08.732 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 49 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1607316092,v1:127.0.0.1:6851/1607316092] [v2:127.0.0.1:6852/1607316092,v1:127.0.0.1:6853/1607316092] exists,up bc814d8e-e7a4-4eae-8994-b84986d3c571 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 7 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:08.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/7 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/7' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/7/journal' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:08.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:08.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/7 2026-02-18T00:13:08.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:08.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=42d4c9ab-516d-4cb6-bab1-994b2b736dd0 2026-02-18T00:13:08.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 42d4c9ab-516d-4cb6-bab1-994b2b736dd0' 2026-02-18T00:13:08.741 INFO:tasks.workunit.client.0.trial061.stdout:add osd7 42d4c9ab-516d-4cb6-bab1-994b2b736dd0 2026-02-18T00:13:08.741 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:08.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAUBJVpb+1zLBAAMFw7jL6cxPy7JSwYuNDxOg== 2026-02-18T00:13:08.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAUBJVpb+1zLBAAMFw7jL6cxPy7JSwYuNDxOg=="}' 2026-02-18T00:13:08.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 42d4c9ab-516d-4cb6-bab1-994b2b736dd0 -i td/test-erasure-eio/7/new.json 2026-02-18T00:13:08.975 INFO:tasks.workunit.client.0.trial061.stdout:7 2026-02-18T00:13:08.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/7/new.json 2026-02-18T00:13:08.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAUBJVpb+1zLBAAMFw7jL6cxPy7JSwYuNDxOg== --osd-uuid 42d4c9ab-516d-4cb6-bab1-994b2b736dd0 2026-02-18T00:13:09.002 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:08.999+0000 7fa5729e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.000+0000 7fa5729e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.004 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.001+0000 7fa5729e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.005 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.002+0000 7fa5729e0900 -1 bdev(0x55c43f744c00 td/test-erasure-eio/7/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:09.005 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.002+0000 7fa5729e0900 -1 bluestore(td/test-erasure-eio/7) _read_fsid unparsable uuid 2026-02-18T00:13:09.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/7/keyring 2026-02-18T00:13:09.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:09.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-18T00:13:09.353 INFO:tasks.workunit.client.0.trial061.stdout:adding osd7 key to auth repository 2026-02-18T00:13:09.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:09.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-18T00:13:09.667 INFO:tasks.workunit.client.0.trial061.stdout:start osd.7 2026-02-18T00:13:09.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:09.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:09.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:09.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:09.684 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.681+0000 7f92c461f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.685 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.682+0000 7f92c461f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.686 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.683+0000 7f92c461f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:09.819 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:09.816+0000 7f92c461f900 -1 Falling back to public interface 2026-02-18T00:13:09.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-18T00:13:09.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:09.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-18T00:13:09.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:09.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:09.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:09.890 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:09.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:09.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:09.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-18T00:13:10.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:10.124 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:10.121+0000 7f92c461f900 -1 osd.7 0 log_to_monitors true 2026-02-18T00:13:11.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:11.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:11.115 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:11.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:11.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:11.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-18T00:13:11.338 INFO:tasks.workunit.client.0.trial061.stdout:osd.7 up in weight 1 up_from 58 up_thru 60 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/3710757452,v1:127.0.0.1:6859/3710757452] [v2:127.0.0.1:6860/3710757452,v1:127.0.0.1:6861/3710757452] exists,up 42d4c9ab-516d-4cb6-bab1-994b2b736dd0 2026-02-18T00:13:11.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:11.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 8 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/8 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:11.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/8' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/8/journal' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:11.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:11.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/8 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9f62f0ab-7ea9-4e3a-aad0-56a020488f0d 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 9f62f0ab-7ea9-4e3a-aad0-56a020488f0d' 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stdout:add osd8 9f62f0ab-7ea9-4e3a-aad0-56a020488f0d 2026-02-18T00:13:11.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:11.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAXBJVpDPkAFRAAGra4wOM7ZHpdfFojiJv9bQ== 2026-02-18T00:13:11.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAXBJVpDPkAFRAAGra4wOM7ZHpdfFojiJv9bQ=="}' 2026-02-18T00:13:11.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9f62f0ab-7ea9-4e3a-aad0-56a020488f0d -i td/test-erasure-eio/8/new.json 2026-02-18T00:13:11.580 INFO:tasks.workunit.client.0.trial061.stdout:8 2026-02-18T00:13:11.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/8/new.json 2026-02-18T00:13:11.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAXBJVpDPkAFRAAGra4wOM7ZHpdfFojiJv9bQ== --osd-uuid 9f62f0ab-7ea9-4e3a-aad0-56a020488f0d 2026-02-18T00:13:11.605 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:11.602+0000 7f944315d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:11.606 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:11.603+0000 7f944315d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:11.607 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:11.604+0000 7f944315d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:11.608 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:11.605+0000 7f944315d900 -1 bdev(0x5605959d0c00 td/test-erasure-eio/8/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:11.608 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:11.605+0000 7f944315d900 -1 bluestore(td/test-erasure-eio/8) _read_fsid unparsable uuid 2026-02-18T00:13:11.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/8/keyring 2026-02-18T00:13:11.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:11.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-18T00:13:11.931 INFO:tasks.workunit.client.0.trial061.stdout:adding osd8 key to auth repository 2026-02-18T00:13:11.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:12.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-18T00:13:12.244 INFO:tasks.workunit.client.0.trial061.stdout:start osd.8 2026-02-18T00:13:12.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:12.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:12.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:12.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:12.259 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:12.256+0000 7f9d3c4f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:12.260 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:12.257+0000 7f9d3c4f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:12.261 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:12.258+0000 7f9d3c4f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:12.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:12.391+0000 7f9d3c4f8900 -1 Falling back to public interface 2026-02-18T00:13:12.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:12.474 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:12.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:12.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:12.475 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-18T00:13:12.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:12.729 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:12.726+0000 7f9d3c4f8900 -1 osd.8 0 log_to_monitors true 2026-02-18T00:13:13.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:13.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:13.700 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:13.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:13.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:13.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-18T00:13:13.925 INFO:tasks.workunit.client.0.trial061.stdout:osd.8 up in weight 1 up_from 67 up_thru 69 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/2856884953,v1:127.0.0.1:6867/2856884953] [v2:127.0.0.1:6868/2856884953,v1:127.0.0.1:6869/2856884953] exists,up 9f62f0ab-7ea9-4e3a-aad0-56a020488f0d 2026-02-18T00:13:13.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:13.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:13.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:13:13.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:13:13.972 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:13:13.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:13:13.978 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:12:51.890+0000 7fbc0c71c900 0 load: jerasure load: lrc 2026-02-18T00:13:13.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:443: TEST_ec_recovery_multiple_errors: local poolname=pool-jerasure 2026-02-18T00:13:13.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:444: TEST_ec_recovery_multiple_errors: create_erasure_coded_pool pool-jerasure 4 4 2026-02-18T00:13:13.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:13:13.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:13:13.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=4 2026-02-18T00:13:13.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:13:13.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=4 2026-02-18T00:13:13.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:13:13.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=4 m=4 crush-failure-domain=osd 2026-02-18T00:13:14.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:13:14.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:13:14.634 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:13:14.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:13:15.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:13:15.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:13:15.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:13:15.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:13:15.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:13:15.645 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:13:15.645 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:13:15.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:13:15.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:13:15.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:13:15.730 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:15.955 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:13:15.956 INFO:tasks.workunit.client.0.trial061.stderr:8' 2026-02-18T00:13:15.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:13:15.956 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:15.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:13:16.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803783 2026-02-18T00:13:16.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803783 2026-02-18T00:13:16.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783' 2026-02-18T00:13:16.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:13:16.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607559 2026-02-18T00:13:16.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607559 2026-02-18T00:13:16.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559' 2026-02-18T00:13:16.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:13:16.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444038 2026-02-18T00:13:16.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444038 2026-02-18T00:13:16.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038' 2026-02-18T00:13:16.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:13:16.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-18T00:13:16.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-18T00:13:16.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110' 2026-02-18T00:13:16.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.212 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:13:16.276 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953477 2026-02-18T00:13:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953477 2026-02-18T00:13:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110 4-137438953477' 2026-02-18T00:13:16.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:13:16.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691845 2026-02-18T00:13:16.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691845 2026-02-18T00:13:16.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110 4-137438953477 5-171798691845' 2026-02-18T00:13:16.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.341 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:13:16.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397509 2026-02-18T00:13:16.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397509 2026-02-18T00:13:16.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110 4-137438953477 5-171798691845 6-210453397509' 2026-02-18T00:13:16.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.405 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:13:16.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103173 2026-02-18T00:13:16.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103173 2026-02-18T00:13:16.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110 4-137438953477 5-171798691845 6-210453397509 7-249108103173' 2026-02-18T00:13:16.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:16.469 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:13:16.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-18T00:13:16.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-18T00:13:16.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607559 2-73014444038 3-103079215110 4-137438953477 5-171798691845 6-210453397509 7-249108103173 8-287762808835' 2026-02-18T00:13:16.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:16.533 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803783 2026-02-18T00:13:16.533 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:16.534 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:13:16.534 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803783 2026-02-18T00:13:16.535 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:16.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803783 2026-02-18T00:13:16.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803783' 2026-02-18T00:13:16.536 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803783 2026-02-18T00:13:16.536 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:16.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803783 2026-02-18T00:13:16.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:13:17.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:13:17.764 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:17.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803783 2026-02-18T00:13:17.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:17.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607559 2026-02-18T00:13:17.990 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:17.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:13:17.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607559 2026-02-18T00:13:17.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:17.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607559 2026-02-18T00:13:17.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607559' 2026-02-18T00:13:17.993 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607559 2026-02-18T00:13:17.993 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:13:18.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607559 -lt 51539607559 2026-02-18T00:13:18.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:18.222 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444038 2026-02-18T00:13:18.222 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:18.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:13:18.223 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444038 2026-02-18T00:13:18.223 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:18.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444038 2026-02-18T00:13:18.224 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 73014444038 2026-02-18T00:13:18.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444038' 2026-02-18T00:13:18.225 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:13:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444038 -lt 73014444038 2026-02-18T00:13:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:18.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215110 2026-02-18T00:13:18.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:18.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:13:18.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215110 2026-02-18T00:13:18.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:18.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215110 2026-02-18T00:13:18.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215110' 2026-02-18T00:13:18.454 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 103079215110 2026-02-18T00:13:18.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:13:18.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215110 -lt 103079215110 2026-02-18T00:13:18.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:18.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-137438953477 2026-02-18T00:13:18.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:18.678 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:13:18.678 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-137438953477 2026-02-18T00:13:18.679 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:18.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=137438953477 2026-02-18T00:13:18.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 137438953477' 2026-02-18T00:13:18.680 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 137438953477 2026-02-18T00:13:18.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:13:18.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 137438953477 -lt 137438953477 2026-02-18T00:13:18.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:18.903 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-171798691845 2026-02-18T00:13:18.903 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:18.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:13:18.905 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-171798691845 2026-02-18T00:13:18.905 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:18.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691845 2026-02-18T00:13:18.906 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 171798691845' 2026-02-18T00:13:18.906 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 171798691845 2026-02-18T00:13:18.906 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:13:19.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691845 -lt 171798691845 2026-02-18T00:13:19.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:19.138 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-210453397509 2026-02-18T00:13:19.138 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:19.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:13:19.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-210453397509 2026-02-18T00:13:19.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:19.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397509 2026-02-18T00:13:19.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 210453397509' 2026-02-18T00:13:19.141 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 210453397509 2026-02-18T00:13:19.141 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:13:19.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397509 -lt 210453397509 2026-02-18T00:13:19.364 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:19.365 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-249108103173 2026-02-18T00:13:19.365 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:19.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-18T00:13:19.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-249108103173 2026-02-18T00:13:19.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:19.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103173 2026-02-18T00:13:19.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 249108103173' 2026-02-18T00:13:19.367 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.7 seq 249108103173 2026-02-18T00:13:19.368 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-18T00:13:19.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103173 -lt 249108103173 2026-02-18T00:13:19.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:19.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-287762808835 2026-02-18T00:13:19.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:19.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:13:19.596 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-287762808835 2026-02-18T00:13:19.597 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:19.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808835 2026-02-18T00:13:19.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 287762808835' 2026-02-18T00:13:19.598 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 287762808835 2026-02-18T00:13:19.598 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:13:19.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-18T00:13:19.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:13:19.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:19.821 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:20.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:13:20.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:13:20.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:13:20.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:13:20.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:20.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:446: TEST_ec_recovery_multiple_errors: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-18T00:13:20.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:13:20.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:447: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:13:20.697 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:13:20.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:13:20.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:13:20.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:13:20.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:13:20.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:13:20.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:13:20.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:13:20.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:13:20.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:13:20.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:13:20.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:13:20.924 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:20.925 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:20.925 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:20.925 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:13:20.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:13:20.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:13:20.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:13:20.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:13:20.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:13:20.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:13:20.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-18T00:13:21.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:450: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 3 2026-02-18T00:13:21.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:13:21.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=3 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:13:21.024 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:13:21.025 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:13:21.025 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:13:21.025 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:21.256 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=0 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:13:21.257 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/0/type 2026-02-18T00:13:21.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:13:21.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:21.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:13:21.261 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:13:21.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:13:21.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:13:21.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.0 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:13:21.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok injectdataerr pool-jerasure myobject 3 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:451: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 4 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:13:21.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=4 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:13:21.362 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:13:21.590 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:13:21.590 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:21.590 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:21.590 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=6 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:13:21.591 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/6/type 2026-02-18T00:13:21.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:13:21.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 6 bluestore_debug_inject_read_err true 2026-02-18T00:13:21.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:13:21.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=6 2026-02-18T00:13:21.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.6 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.6 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.6 ']' 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.6.asok 2026-02-18T00:13:21.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.6.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:13:21.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:13:21.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:13:21.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:13:21.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.6 2026-02-18T00:13:21.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.6 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.6 ']' 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.6.asok 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:13:21.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.6.asok injectdataerr pool-jerasure myobject 4 2026-02-18T00:13:21.694 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: get_osds pool-jerasure myobject 2026-02-18T00:13:21.694 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:13:21.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:13:21.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:13:21.695 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:13:21.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:13:21.921 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:21.921 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:21.921 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:7' 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-18T00:13:21.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: local -a initial_osds 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:454: TEST_ec_recovery_multiple_errors: local last_osd=7 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:456: TEST_ec_recovery_multiple_errors: kill_daemons td/test-erasure-eio TERM osd.7 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:13:21.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:13:22.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:13:22.228 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:457: TEST_ec_recovery_multiple_errors: ceph osd down 7 2026-02-18T00:13:22.451 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already down. 2026-02-18T00:13:22.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:458: TEST_ec_recovery_multiple_errors: ceph osd out 7 2026-02-18T00:13:22.706 INFO:tasks.workunit.client.0.trial061.stderr:osd.7 is already out. 2026-02-18T00:13:22.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:461: TEST_ec_recovery_multiple_errors: wait_for_clean 2026-02-18T00:13:22.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:13:22.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:13:22.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:13:22.716 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:13:22.716 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:13:22.717 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:13:22.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:13:22.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:13:22.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:13:22.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:13:22.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:13:22.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:13:22.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:13:22.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:13:22.801 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:13:23.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:13:23.030 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:23.030 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:23.030 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:6 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:7 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:8' 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.031 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:13:23.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803786 2026-02-18T00:13:23.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803786 2026-02-18T00:13:23.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786' 2026-02-18T00:13:23.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.099 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:13:23.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607562 2026-02-18T00:13:23.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607562 2026-02-18T00:13:23.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562' 2026-02-18T00:13:23.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:13:23.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444041 2026-02-18T00:13:23.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444041 2026-02-18T00:13:23.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041' 2026-02-18T00:13:23.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:13:23.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215113 2026-02-18T00:13:23.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215113 2026-02-18T00:13:23.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041 3-103079215113' 2026-02-18T00:13:23.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.294 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:13:23.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953480 2026-02-18T00:13:23.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953480 2026-02-18T00:13:23.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041 3-103079215113 4-137438953480' 2026-02-18T00:13:23.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:13:23.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691848 2026-02-18T00:13:23.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691848 2026-02-18T00:13:23.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041 3-103079215113 4-137438953480 5-171798691848' 2026-02-18T00:13:23.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:13:23.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397512 2026-02-18T00:13:23.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397512 2026-02-18T00:13:23.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041 3-103079215113 4-137438953480 5-171798691848 6-210453397512' 2026-02-18T00:13:23.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-18T00:13:23.530 INFO:tasks.workunit.client.0.trial061.stderr:Error ENXIO: problem getting command descriptions from osd.7 2026-02-18T00:13:23.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T00:13:23.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T00:13:23.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T00:13:23.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:23.531 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808838 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808838 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607562 2-73014444041 3-103079215113 4-137438953480 5-171798691848 6-210453397512 8-287762808838' 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803786 2026-02-18T00:13:23.592 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:23.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:13:23.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803786 2026-02-18T00:13:23.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:23.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803786 2026-02-18T00:13:23.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803786' 2026-02-18T00:13:23.595 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803786 2026-02-18T00:13:23.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:23.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803786 2026-02-18T00:13:23.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:13:24.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:13:24.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:25.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803786 2026-02-18T00:13:25.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:25.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607562 2026-02-18T00:13:25.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:25.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:13:25.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607562 2026-02-18T00:13:25.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:25.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607562 2026-02-18T00:13:25.048 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607562 2026-02-18T00:13:25.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607562' 2026-02-18T00:13:25.049 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:13:25.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607562 -lt 51539607562 2026-02-18T00:13:25.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:25.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444041 2026-02-18T00:13:25.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:25.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:13:25.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444041 2026-02-18T00:13:25.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:25.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444041 2026-02-18T00:13:25.280 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 73014444041 2026-02-18T00:13:25.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444041' 2026-02-18T00:13:25.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:13:25.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444042 -lt 73014444041 2026-02-18T00:13:25.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:25.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215113 2026-02-18T00:13:25.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:25.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:13:25.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215113 2026-02-18T00:13:25.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:25.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215113 2026-02-18T00:13:25.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215113' 2026-02-18T00:13:25.507 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 103079215113 2026-02-18T00:13:25.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:13:25.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215113 -lt 103079215113 2026-02-18T00:13:25.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:25.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-137438953480 2026-02-18T00:13:25.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:25.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:13:25.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-137438953480 2026-02-18T00:13:25.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:25.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=137438953480 2026-02-18T00:13:25.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 137438953480' 2026-02-18T00:13:25.737 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 137438953480 2026-02-18T00:13:25.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:13:25.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 137438953481 -lt 137438953480 2026-02-18T00:13:25.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:25.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-171798691848 2026-02-18T00:13:25.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:25.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:13:25.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-171798691848 2026-02-18T00:13:25.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:25.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691848 2026-02-18T00:13:25.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 171798691848' 2026-02-18T00:13:25.965 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 171798691848 2026-02-18T00:13:25.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:13:26.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691848 -lt 171798691848 2026-02-18T00:13:26.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:26.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-210453397512 2026-02-18T00:13:26.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:26.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:13:26.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-210453397512 2026-02-18T00:13:26.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:26.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397512 2026-02-18T00:13:26.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 210453397512' 2026-02-18T00:13:26.191 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 210453397512 2026-02-18T00:13:26.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:13:26.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397513 -lt 210453397512 2026-02-18T00:13:26.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:26.412 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-287762808838 2026-02-18T00:13:26.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:26.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-18T00:13:26.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-287762808838 2026-02-18T00:13:26.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:26.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808838 2026-02-18T00:13:26.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 287762808838' 2026-02-18T00:13:26.416 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.8 seq 287762808838 2026-02-18T00:13:26.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-18T00:13:26.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808839 -lt 287762808838 2026-02-18T00:13:26.642 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:13:26.642 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:26.642 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:13:26.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:13:26.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:13:26.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:13:27.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:13:27.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:13:27.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:27.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:27.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:463: TEST_ec_recovery_multiple_errors: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:13:27.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-18T00:13:27.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:13:27.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:13:27.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:465: TEST_ec_recovery_multiple_errors: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:13:27.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:13:27.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:13:27.795 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:13:27.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:13:28.089 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:13:28.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:13:28.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:13:28.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:13:28.210 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:13:28.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:13:28.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:13:28.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:13:28.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:13:28.213 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:13:28.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:13:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:13:28.214 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:13:28.215 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:13:28.215 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:13:28.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:13:28.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:13:28.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:13:28.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:13:28.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:13:28.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:13:28.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:13:28.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:13:28.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:13:28.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:13:28.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:13:28.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:13:28.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:13:28.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:13:28.240 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:13:28.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:28.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:13:28.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:13:28.242 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:28.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:13:28.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:13:28.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:13:28.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:13:28.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:13:28.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:13:28.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:13:28.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:13:28.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:13:28.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:13:28.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:13:28.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:13:28.269 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:28.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:13:28.295 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:13:28.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:13:28.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:13:28.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:13:28.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:13:28.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:13:28.297 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:13:28.297 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:13:28.297 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:13:28.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:13:28.344 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.345 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:13:28.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:13:28.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:13:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:28.489 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:28.490 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:28.490 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:13:28.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:13:28.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:13:28.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:13:28.606 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:13:28.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:13:29.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:13:29.657 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:13:29.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:13:29.662 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:13:28.286+0000 7f9875018d80 0 load: jerasure load: lrc 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects td/test-erasure-eio 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:471: TEST_ec_recovery_multiple_objects: local dir=td/test-erasure-eio 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:472: TEST_ec_recovery_multiple_objects: local objname=myobject 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:474: TEST_ec_recovery_multiple_objects: ORIG_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:475: TEST_ec_recovery_multiple_objects: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:476: TEST_ec_recovery_multiple_objects: setup_osds 7 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:13:29.663 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-18T00:13:29.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-18T00:13:29.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:29.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:29.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:29.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:13:29.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:29.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2f497a4b-83fa-4db4-af71-a1766908c407 2026-02-18T00:13:29.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2f497a4b-83fa-4db4-af71-a1766908c407' 2026-02-18T00:13:29.668 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 2f497a4b-83fa-4db4-af71-a1766908c407 2026-02-18T00:13:29.668 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:29.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQApBJVprXGPKBAAPf1xyp/Y3emwXIbL3tj7fA== 2026-02-18T00:13:29.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQApBJVprXGPKBAAPf1xyp/Y3emwXIbL3tj7fA=="}' 2026-02-18T00:13:29.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2f497a4b-83fa-4db4-af71-a1766908c407 -i td/test-erasure-eio/0/new.json 2026-02-18T00:13:29.789 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:13:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQApBJVprXGPKBAAPf1xyp/Y3emwXIbL3tj7fA== --osd-uuid 2f497a4b-83fa-4db4-af71-a1766908c407 2026-02-18T00:13:29.816 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:29.814+0000 7f6087f46900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:29.818 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:29.816+0000 7f6087f46900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:29.819 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:29.817+0000 7f6087f46900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:29.820 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:29.818+0000 7f6087f46900 -1 bdev(0x55e385f26c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:29.820 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:29.818+0000 7f6087f46900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:13:30.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:13:30.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:30.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:13:30.264 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:13:30.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:30.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:13:30.374 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:13:30.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:30.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:30.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:30.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:30.394 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:30.391+0000 7f8eb8eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:30.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:30.393+0000 7f8eb8eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:30.396 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:30.394+0000 7f8eb8eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:30.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:30.477 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:30.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:30.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:30.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:13:30.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:30.622 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:30.621+0000 7f8eb8eba900 -1 Falling back to public interface 2026-02-18T00:13:30.908 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:30.906+0000 7f8eb8eba900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:31.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:13:31.805 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2273835399,v1:127.0.0.1:6803/2273835399] [v2:127.0.0.1:6804/2273835399,v1:127.0.0.1:6805/2273835399] exists,up 2f497a4b-83fa-4db4-af71-a1766908c407 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:31.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:31.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:13:31.808 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:31.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4eb3ffc4-c9c6-4b33-960f-8127b9858295 2026-02-18T00:13:31.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 4eb3ffc4-c9c6-4b33-960f-8127b9858295' 2026-02-18T00:13:31.809 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 4eb3ffc4-c9c6-4b33-960f-8127b9858295 2026-02-18T00:13:31.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:31.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQArBJVptWLpMBAAu2qgkq8GuMWH4fZhinxLWQ== 2026-02-18T00:13:31.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQArBJVptWLpMBAAu2qgkq8GuMWH4fZhinxLWQ=="}' 2026-02-18T00:13:31.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4eb3ffc4-c9c6-4b33-960f-8127b9858295 -i td/test-erasure-eio/1/new.json 2026-02-18T00:13:32.052 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:32.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:13:32.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQArBJVptWLpMBAAu2qgkq8GuMWH4fZhinxLWQ== --osd-uuid 4eb3ffc4-c9c6-4b33-960f-8127b9858295 2026-02-18T00:13:32.082 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.080+0000 7f6d2966b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.083 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.081+0000 7f6d2966b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.084 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.082+0000 7f6d2966b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.084 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.082+0000 7f6d2966b900 -1 bdev(0x55e695218c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:32.085 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.082+0000 7f6d2966b900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:13:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:13:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:13:32.400 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:13:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:32.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:32.772 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.770+0000 7fbd4cea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.774 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.772+0000 7fbd4cea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.775 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.773+0000 7fbd4cea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:32.895 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:32.893+0000 7fbd4cea8900 -1 Falling back to public interface 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:32.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:32.986 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:32.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:32.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:13:33.200 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:33.198+0000 7fbd4cea8900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:13:33.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:34.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:34.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:34.213 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:34.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:34.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:34.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:13:34.438 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2190899744,v1:127.0.0.1:6811/2190899744] [v2:127.0.0.1:6812/2190899744,v1:127.0.0.1:6813/2190899744] exists,up 4eb3ffc4-c9c6-4b33-960f-8127b9858295 2026-02-18T00:13:34.441 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:34.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:34.443 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:34.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:34.445 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:34.445 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:13:34.445 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:34.445 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=21185f2c-3bb9-4f2a-9ff5-912e70100ccb 2026-02-18T00:13:34.446 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 21185f2c-3bb9-4f2a-9ff5-912e70100ccb 2026-02-18T00:13:34.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 21185f2c-3bb9-4f2a-9ff5-912e70100ccb' 2026-02-18T00:13:34.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:34.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAuBJVpGqoIGxAAvZ74QtgBmRmGdbYCfo7T+Q== 2026-02-18T00:13:34.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAuBJVpGqoIGxAAvZ74QtgBmRmGdbYCfo7T+Q=="}' 2026-02-18T00:13:34.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 21185f2c-3bb9-4f2a-9ff5-912e70100ccb -i td/test-erasure-eio/2/new.json 2026-02-18T00:13:34.683 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:13:34.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:13:34.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAuBJVpGqoIGxAAvZ74QtgBmRmGdbYCfo7T+Q== --osd-uuid 21185f2c-3bb9-4f2a-9ff5-912e70100ccb 2026-02-18T00:13:34.711 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:34.709+0000 7f283ab3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:34.713 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:34.711+0000 7f283ab3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:34.714 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:34.712+0000 7f283ab3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:34.714 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:34.712+0000 7f283ab3d900 -1 bdev(0x565127ac0c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:34.714 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:34.712+0000 7f283ab3d900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:13:35.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:13:35.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:35.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:13:35.036 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:13:35.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:35.353 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:13:35.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:13:35.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:35.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:35.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:35.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:35.372 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:35.370+0000 7fd542822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:35.374 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:35.372+0000 7fd542822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:35.375 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:35.373+0000 7fd542822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:35.503 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:35.501+0000 7fd542822900 -1 Falling back to public interface 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:35.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:35.578 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:35.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:35.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:13:35.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:35.861 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:35.859+0000 7fd542822900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:13:36.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:36.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:36.804 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:36.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:36.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:36.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:13:37.031 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1978271536,v1:127.0.0.1:6819/1978271536] [v2:127.0.0.1:6820/1978271536,v1:127.0.0.1:6821/1978271536] exists,up 21185f2c-3bb9-4f2a-9ff5-912e70100ccb 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:37.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:37.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:37.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5d6324af-051a-4343-aac0-acf866502dc5 2026-02-18T00:13:37.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5d6324af-051a-4343-aac0-acf866502dc5' 2026-02-18T00:13:37.039 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 5d6324af-051a-4343-aac0-acf866502dc5 2026-02-18T00:13:37.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:37.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAxBJVpbS7AAhAA3jlyerZTVmlTGqN+cX/Mkw== 2026-02-18T00:13:37.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAxBJVpbS7AAhAA3jlyerZTVmlTGqN+cX/Mkw=="}' 2026-02-18T00:13:37.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5d6324af-051a-4343-aac0-acf866502dc5 -i td/test-erasure-eio/3/new.json 2026-02-18T00:13:37.279 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:13:37.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:13:37.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAxBJVpbS7AAhAA3jlyerZTVmlTGqN+cX/Mkw== --osd-uuid 5d6324af-051a-4343-aac0-acf866502dc5 2026-02-18T00:13:37.309 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.307+0000 7f2bbf12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:37.310 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.308+0000 7f2bbf12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:37.311 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.309+0000 7f2bbf12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:37.312 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.310+0000 7f2bbf12d900 -1 bdev(0x5643fbec0c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:37.312 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.310+0000 7f2bbf12d900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:13:37.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:13:37.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:13:37.632 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:13:37.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:37.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:13:37.945 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:13:37.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:37.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:37.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:37.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:37.964 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.962+0000 7f1443d59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:37.965 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.963+0000 7f1443d59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:37.966 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:37.964+0000 7f1443d59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:38.102 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:38.099+0000 7f1443d59900 -1 Falling back to public interface 2026-02-18T00:13:38.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:13:38.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:38.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:13:38.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:38.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:38.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:38.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:38.173 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:38.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:38.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:13:38.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:38.433 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:38.431+0000 7f1443d59900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:13:39.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:39.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:39.404 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:39.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:39.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:39.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:13:39.630 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2072244473,v1:127.0.0.1:6827/2072244473] [v2:127.0.0.1:6828/2072244473,v1:127.0.0.1:6829/2072244473] exists,up 5d6324af-051a-4343-aac0-acf866502dc5 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:13:39.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:39.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:39.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=451c89ef-e7d7-4cc3-95c9-7eaed099a508 2026-02-18T00:13:39.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 451c89ef-e7d7-4cc3-95c9-7eaed099a508' 2026-02-18T00:13:39.638 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 451c89ef-e7d7-4cc3-95c9-7eaed099a508 2026-02-18T00:13:39.638 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:39.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAzBJVpFl10JhAAmq386+BDDjkOqFaHJ6j4MQ== 2026-02-18T00:13:39.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAzBJVpFl10JhAAmq386+BDDjkOqFaHJ6j4MQ=="}' 2026-02-18T00:13:39.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 451c89ef-e7d7-4cc3-95c9-7eaed099a508 -i td/test-erasure-eio/4/new.json 2026-02-18T00:13:39.874 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:13:39.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:13:39.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAzBJVpFl10JhAAmq386+BDDjkOqFaHJ6j4MQ== --osd-uuid 451c89ef-e7d7-4cc3-95c9-7eaed099a508 2026-02-18T00:13:39.902 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:39.900+0000 7f44c7bae900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:39.903 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:39.901+0000 7f44c7bae900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:39.904 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:39.902+0000 7f44c7bae900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:39.904 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:39.903+0000 7f44c7bae900 -1 bdev(0x562a77a12c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:39.905 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:39.903+0000 7f44c7bae900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:13:40.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:13:40.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:40.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:13:40.233 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:13:40.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:40.572 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:13:40.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:13:40.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:40.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:40.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:40.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:40.590 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:40.588+0000 7fee48188900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:40.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:40.590+0000 7fee48188900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:40.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:40.590+0000 7fee48188900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:40.731 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:40.728+0000 7fee48188900 -1 Falling back to public interface 2026-02-18T00:13:40.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:13:40.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:40.804 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:40.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:40.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:13:41.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:41.068 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:41.066+0000 7fee48188900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:13:42.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:42.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:42.027 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:42.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:42.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:42.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:13:42.253 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 36 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3779724902,v1:127.0.0.1:6835/3779724902] [v2:127.0.0.1:6836/3779724902,v1:127.0.0.1:6837/3779724902] exists,up 451c89ef-e7d7-4cc3-95c9-7eaed099a508 2026-02-18T00:13:42.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:42.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:42.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:42.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bb97f449-38f9-464a-a537-94cb193c46eb 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 bb97f449-38f9-464a-a537-94cb193c46eb' 2026-02-18T00:13:42.261 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 bb97f449-38f9-464a-a537-94cb193c46eb 2026-02-18T00:13:42.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:42.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA2BJVp2878DxAAcmziJqTq1+w17Wjh4y7vGA== 2026-02-18T00:13:42.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA2BJVp2878DxAAcmziJqTq1+w17Wjh4y7vGA=="}' 2026-02-18T00:13:42.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bb97f449-38f9-464a-a537-94cb193c46eb -i td/test-erasure-eio/5/new.json 2026-02-18T00:13:42.499 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:13:42.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-18T00:13:42.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2BJVp2878DxAAcmziJqTq1+w17Wjh4y7vGA== --osd-uuid bb97f449-38f9-464a-a537-94cb193c46eb 2026-02-18T00:13:42.528 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:42.526+0000 7f6e0fd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:42.529 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:42.527+0000 7f6e0fd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:42.530 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:42.528+0000 7f6e0fd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:42.531 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:42.529+0000 7f6e0fd3d900 -1 bdev(0x555a0f20cc00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:42.531 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:42.529+0000 7f6e0fd3d900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-18T00:13:42.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-18T00:13:42.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:42.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:13:42.873 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:13:42.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:43.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:13:43.186 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:13:43.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:43.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:43.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:43.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:43.204 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:43.202+0000 7f024d0f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:43.206 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:43.204+0000 7f024d0f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:43.207 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:43.205+0000 7f024d0f8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:43.343 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:43.340+0000 7f024d0f8900 -1 Falling back to public interface 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:43.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:43.417 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:43.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:43.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:13:43.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:43.674 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:43.672+0000 7f024d0f8900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:13:44.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:44.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:44.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:44.649 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:44.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:44.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:13:44.873 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 43 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2095891212,v1:127.0.0.1:6843/2095891212] [v2:127.0.0.1:6844/2095891212,v1:127.0.0.1:6845/2095891212] exists,up bb97f449-38f9-464a-a537-94cb193c46eb 2026-02-18T00:13:44.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:13:44.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:44.878 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:13:44.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=22022da6-adce-4b65-b9a1-a2a935191daa 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 22022da6-adce-4b65-b9a1-a2a935191daa' 2026-02-18T00:13:44.880 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 22022da6-adce-4b65-b9a1-a2a935191daa 2026-02-18T00:13:44.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:13:44.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA4BJVp8A7uNBAAwhPsfN2r8n0zvHw1vnUzug== 2026-02-18T00:13:44.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA4BJVp8A7uNBAAwhPsfN2r8n0zvHw1vnUzug=="}' 2026-02-18T00:13:44.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 22022da6-adce-4b65-b9a1-a2a935191daa -i td/test-erasure-eio/6/new.json 2026-02-18T00:13:45.120 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:13:45.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-18T00:13:45.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA4BJVp8A7uNBAAwhPsfN2r8n0zvHw1vnUzug== --osd-uuid 22022da6-adce-4b65-b9a1-a2a935191daa 2026-02-18T00:13:45.149 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.147+0000 7f1418dc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.150 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.148+0000 7f1418dc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.151 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.149+0000 7f1418dc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.152 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.149+0000 7f1418dc7900 -1 bdev(0x55e8d139ec00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:13:45.152 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.150+0000 7f1418dc7900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-18T00:13:45.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-18T00:13:45.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:13:45.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:13:45.479 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:13:45.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:13:45.796 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:13:45.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:13:45.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:13:45.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:13:45.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:13:45.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:13:45.815 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.813+0000 7f4c21270900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.817 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.815+0000 7f4c21270900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.818 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.815+0000 7f4c21270900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:13:45.943 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:45.940+0000 7f4c21270900 -1 Falling back to public interface 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:46.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:13:46.022 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:13:46.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:46.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:13:46.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:13:46.289 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:13:46.287+0000 7f4c21270900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:13:47.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:13:47.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:13:47.248 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:13:47.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:13:47.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:13:47.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:13:47.471 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/4125845435,v1:127.0.0.1:6851/4125845435] [v2:127.0.0.1:6852/4125845435,v1:127.0.0.1:6853/4125845435] exists,up 22022da6-adce-4b65-b9a1-a2a935191daa 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:13:47.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:13:47.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:13:47.518 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:13:47.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:13:47.524 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:13:30.623+0000 7f8eb8eba900 0 load: jerasure load: lrc 2026-02-18T00:13:47.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:477: TEST_ec_recovery_multiple_objects: CEPH_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:13:47.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:479: TEST_ec_recovery_multiple_objects: local poolname=pool-jerasure 2026-02-18T00:13:47.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:480: TEST_ec_recovery_multiple_objects: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:13:47.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:13:47.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:13:47.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:13:48.179 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:13:48.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:13:49.188 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:13:49.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:13:49.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:13:49.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:13:49.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:13:49.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:13:49.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:13:49.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:13:49.274 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:13:49.274 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:13:49.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:13:49.498 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:49.498 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:49.498 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:13:49.498 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:49.499 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:49.499 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:13:49.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:13:49.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.499 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:13:49.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-18T00:13:49.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-18T00:13:49.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-18T00:13:49.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.562 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:13:49.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607559 2026-02-18T00:13:49.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607559 2026-02-18T00:13:49.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559' 2026-02-18T00:13:49.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:13:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-18T00:13:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-18T00:13:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559 2-77309411333' 2026-02-18T00:13:49.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.687 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:13:49.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116997 2026-02-18T00:13:49.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116997 2026-02-18T00:13:49.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559 2-77309411333 3-115964116997' 2026-02-18T00:13:49.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:13:49.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-18T00:13:49.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-18T00:13:49.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559 2-77309411333 3-115964116997 4-154618822660' 2026-02-18T00:13:49.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:13:49.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593732 2026-02-18T00:13:49.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593732 2026-02-18T00:13:49.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559 2-77309411333 3-115964116997 4-154618822660 5-184683593732' 2026-02-18T00:13:49.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:49.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:13:49.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364803 2026-02-18T00:13:49.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364803 2026-02-18T00:13:49.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607559 2-77309411333 3-115964116997 4-154618822660 5-184683593732 6-214748364803' 2026-02-18T00:13:49.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:49.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-18T00:13:49.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:49.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:13:49.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-18T00:13:49.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:49.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-18T00:13:49.946 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803782 2026-02-18T00:13:49.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-18T00:13:49.947 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:50.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-18T00:13:50.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:13:51.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:13:51.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:51.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-18T00:13:51.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:51.399 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607559 2026-02-18T00:13:51.399 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:51.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:13:51.400 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607559 2026-02-18T00:13:51.400 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:51.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607559 2026-02-18T00:13:51.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607559' 2026-02-18T00:13:51.402 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607559 2026-02-18T00:13:51.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:13:51.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607559 -lt 51539607559 2026-02-18T00:13:51.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:51.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411333 2026-02-18T00:13:51.629 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:51.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:13:51.630 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411333 2026-02-18T00:13:51.630 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:51.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411333 2026-02-18T00:13:51.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-18T00:13:51.631 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411333 2026-02-18T00:13:51.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:13:51.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-18T00:13:51.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:51.857 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116997 2026-02-18T00:13:51.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:51.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:13:51.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116997 2026-02-18T00:13:51.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:51.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116997 2026-02-18T00:13:51.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116997' 2026-02-18T00:13:51.860 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116997 2026-02-18T00:13:51.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:13:52.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116997 -lt 115964116997 2026-02-18T00:13:52.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:52.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822660 2026-02-18T00:13:52.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:52.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:13:52.086 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822660 2026-02-18T00:13:52.087 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:52.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822660 2026-02-18T00:13:52.088 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 154618822660 2026-02-18T00:13:52.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822660' 2026-02-18T00:13:52.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:13:52.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-18T00:13:52.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:52.324 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-184683593732 2026-02-18T00:13:52.324 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:52.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:13:52.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-184683593732 2026-02-18T00:13:52.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:52.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593732 2026-02-18T00:13:52.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 184683593732' 2026-02-18T00:13:52.327 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 184683593732 2026-02-18T00:13:52.327 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:13:52.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593732 -lt 184683593732 2026-02-18T00:13:52.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:52.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364803 2026-02-18T00:13:52.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:52.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:13:52.550 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364803 2026-02-18T00:13:52.550 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:52.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364803 2026-02-18T00:13:52.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364803' 2026-02-18T00:13:52.552 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 214748364803 2026-02-18T00:13:52.552 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:13:52.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364804 -lt 214748364803 2026-02-18T00:13:52.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:13:52.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:52.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:13:53.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:13:53.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:13:53.300 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:13:53.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:53.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:53.608 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:482: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:13:53.609 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:13:53.610 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:13:53.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:483: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-18T00:13:53.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:13:53.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:13:53.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-18T00:13:53.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:13:53.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-18T00:13:53.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:484: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:13:53.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:13:53.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-18T00:13:53.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:486: TEST_ec_recovery_multiple_objects: ceph osd out 0 2026-02-18T00:13:53.945 INFO:tasks.workunit.client.0.trial061.stderr:osd.0 is already out. 2026-02-18T00:13:53.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:489: TEST_ec_recovery_multiple_objects: wait_for_clean 2026-02-18T00:13:53.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:13:53.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:13:53.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:13:53.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:13:53.956 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:13:53.956 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:13:53.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:13:53.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:13:53.956 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:13:54.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:13:54.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:13:54.262 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:13:54.262 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.263 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:13:54.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:13:54.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:13:54.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:13:54.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.328 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:13:54.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607562 2026-02-18T00:13:54.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607562 2026-02-18T00:13:54.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562' 2026-02-18T00:13:54.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:13:54.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411336 2026-02-18T00:13:54.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411336 2026-02-18T00:13:54.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562 2-77309411336' 2026-02-18T00:13:54.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:13:54.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116999 2026-02-18T00:13:54.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116999 2026-02-18T00:13:54.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562 2-77309411336 3-115964116999' 2026-02-18T00:13:54.521 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.521 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:13:54.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822663 2026-02-18T00:13:54.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822663 2026-02-18T00:13:54.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562 2-77309411336 3-115964116999 4-154618822663' 2026-02-18T00:13:54.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.586 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:13:54.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593734 2026-02-18T00:13:54.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593734 2026-02-18T00:13:54.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562 2-77309411336 3-115964116999 4-154618822663 5-184683593734' 2026-02-18T00:13:54.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:13:54.651 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:13:54.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364806 2026-02-18T00:13:54.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364806 2026-02-18T00:13:54.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607562 2-77309411336 3-115964116999 4-154618822663 5-184683593734 6-214748364806' 2026-02-18T00:13:54.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:54.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:13:54.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:54.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:13:54.718 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:13:54.718 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:54.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:13:54.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:13:54.720 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803785 2026-02-18T00:13:54.720 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:13:54.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-18T00:13:54.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:54.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607562 2026-02-18T00:13:54.948 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:54.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:13:54.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607562 2026-02-18T00:13:54.949 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:54.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607562 2026-02-18T00:13:54.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607562' 2026-02-18T00:13:54.951 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607562 2026-02-18T00:13:54.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:13:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607562 -lt 51539607562 2026-02-18T00:13:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:55.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411336 2026-02-18T00:13:55.177 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:13:55.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411336 2026-02-18T00:13:55.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:55.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411336 2026-02-18T00:13:55.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411336' 2026-02-18T00:13:55.179 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411336 2026-02-18T00:13:55.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:13:55.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411336 -lt 77309411336 2026-02-18T00:13:55.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:55.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116999 2026-02-18T00:13:55.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:55.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:13:55.405 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116999 2026-02-18T00:13:55.405 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:55.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116999 2026-02-18T00:13:55.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116999' 2026-02-18T00:13:55.407 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116999 2026-02-18T00:13:55.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:13:55.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116999 -lt 115964116999 2026-02-18T00:13:55.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:55.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822663 2026-02-18T00:13:55.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:55.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:13:55.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822663 2026-02-18T00:13:55.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:55.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822663 2026-02-18T00:13:55.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822663' 2026-02-18T00:13:55.637 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 154618822663 2026-02-18T00:13:55.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:13:55.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822661 -lt 154618822663 2026-02-18T00:13:55.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:13:56.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:13:56.857 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:13:57.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822663 -lt 154618822663 2026-02-18T00:13:57.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:57.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-184683593734 2026-02-18T00:13:57.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:57.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:13:57.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-184683593734 2026-02-18T00:13:57.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:57.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593734 2026-02-18T00:13:57.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 184683593734' 2026-02-18T00:13:57.087 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 184683593734 2026-02-18T00:13:57.087 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:13:57.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593735 -lt 184683593734 2026-02-18T00:13:57.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:13:57.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364806 2026-02-18T00:13:57.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:13:57.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:13:57.320 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364806 2026-02-18T00:13:57.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:13:57.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364806 2026-02-18T00:13:57.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364806' 2026-02-18T00:13:57.322 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 214748364806 2026-02-18T00:13:57.322 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:13:57.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364806 -lt 214748364806 2026-02-18T00:13:57.546 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:13:57.546 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:57.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:57.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:13:57.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:13:58.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:13:58.096 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:13:58.097 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:13:58.097 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:13:58.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:491: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:13:58.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-18T00:13:58.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:13:58.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:13:58.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:492: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:13:58.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-18T00:13:58.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:13:58.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:13:58.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:493: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-18T00:13:58.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:13:58.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:13:58.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-18T00:13:58.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:13:58.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:13:58.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-18T00:13:58.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:13:58.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:13:58.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:495: TEST_ec_recovery_multiple_objects: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:13:58.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:13:58.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:13:58.709 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:13:58.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:13:58.991 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:13:59.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:13:59.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:13:59.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:13:59.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:13:59.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:13:59.001 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:13:59.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:13:59.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:13:59.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:13:59.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:13:59.110 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:13:59.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:13:59.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:13:59.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:13:59.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:13:59.112 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:13:59.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:59.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:13:59.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:13:59.113 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:59.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:13:59.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:13:59.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:13:59.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:13:59.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:13:59.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:13:59.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:13:59.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:13:59.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:13:59.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:13:59.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:13:59.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:13:59.134 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:13:59.134 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:13:59.134 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:13:59.135 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:13:59.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:59.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:13:59.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:13:59.136 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:13:59.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:13:59.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:13:59.138 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:13:59.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:13:59.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:13:59.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:13:59.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:13:59.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:13:59.141 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:13:59.141 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.141 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:13:59.142 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:13:59.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:13:59.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:13:59.143 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:13:59.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:59.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:13:59.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:13:59.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:13:59.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:13:59.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:13:59.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:13:59.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:13:59.192 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:13:59.192 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:13:59.192 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:13:59.192 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:59.193 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.193 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.193 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:13:59.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:13:59.193 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:13:59.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.239 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:13:59.240 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:13:59.240 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:13:59.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:13:59.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:13:59.384 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:13:59.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:13:59.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:13:59.385 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:13:59.385 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:13:59.385 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:13:59.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:13:59.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:13:59.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:13:59.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:13:59.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:13:59.500 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:13:59.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:14:00.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:14:00.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:14:00.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:14:00.509 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:00.509 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:00.510 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:00.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:14:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:14:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:14:00.550 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:14:00.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:14:00.555 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:13:59.181+0000 7ff197984d80 0 load: jerasure load: lrc 2026-02-18T00:14:00.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects_eio td/test-erasure-eio 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:500: TEST_ec_recovery_multiple_objects_eio: local dir=td/test-erasure-eio 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:501: TEST_ec_recovery_multiple_objects_eio: local objname=myobject 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:503: TEST_ec_recovery_multiple_objects_eio: ORIG_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:504: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:505: TEST_ec_recovery_multiple_objects_eio: setup_osds 7 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:14:00.557 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-18T00:14:00.561 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-18T00:14:00.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:14:00.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:00.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:14:00.564 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:00.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91f340ca-bfa2-429e-8b6b-64385e476806 2026-02-18T00:14:00.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 91f340ca-bfa2-429e-8b6b-64385e476806' 2026-02-18T00:14:00.565 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 91f340ca-bfa2-429e-8b6b-64385e476806 2026-02-18T00:14:00.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:00.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBIBJVpY/cZIhAAsUZJCXJc+mHf2kBkTwdnyg== 2026-02-18T00:14:00.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBIBJVpY/cZIhAAsUZJCXJc+mHf2kBkTwdnyg=="}' 2026-02-18T00:14:00.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91f340ca-bfa2-429e-8b6b-64385e476806 -i td/test-erasure-eio/0/new.json 2026-02-18T00:14:00.680 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:00.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:14:00.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBIBJVpY/cZIhAAsUZJCXJc+mHf2kBkTwdnyg== --osd-uuid 91f340ca-bfa2-429e-8b6b-64385e476806 2026-02-18T00:14:00.708 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:00.706+0000 7fdd5a412900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:00.710 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:00.708+0000 7fdd5a412900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:00.711 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:00.709+0000 7fdd5a412900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:00.711 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:00.709+0000 7fdd5a412900 -1 bdev(0x56252ce84c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:00.712 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:00.709+0000 7fdd5a412900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:14:01.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:14:01.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:01.179 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:14:01.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:14:01.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:01.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:14:01.284 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:14:01.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:01.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:01.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:01.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:01.303 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:01.301+0000 7f68dfb62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:01.304 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:01.302+0000 7f68dfb62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:01.305 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:01.303+0000 7f68dfb62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:01.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:01.385 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:01.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:01.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:14:01.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:01.498 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:01.496+0000 7f68dfb62900 -1 Falling back to public interface 2026-02-18T00:14:01.793 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:01.791+0000 7f68dfb62900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:14:02.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:02.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:02.487 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:02.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:02.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:02.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:14:02.712 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2275603160,v1:127.0.0.1:6803/2275603160] [v2:127.0.0.1:6804/2275603160,v1:127.0.0.1:6805/2275603160] exists,up 91f340ca-bfa2-429e-8b6b-64385e476806 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:14:02.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:02.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:02.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3d9c1ab6-27ec-41e0-aa2c-ebea48724287 2026-02-18T00:14:02.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3d9c1ab6-27ec-41e0-aa2c-ebea48724287' 2026-02-18T00:14:02.721 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 3d9c1ab6-27ec-41e0-aa2c-ebea48724287 2026-02-18T00:14:02.721 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:02.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBKBJVpmI5gKxAA+IDWqRSrgr8mFh1KjjLweQ== 2026-02-18T00:14:02.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBKBJVpmI5gKxAA+IDWqRSrgr8mFh1KjjLweQ=="}' 2026-02-18T00:14:02.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3d9c1ab6-27ec-41e0-aa2c-ebea48724287 -i td/test-erasure-eio/1/new.json 2026-02-18T00:14:02.960 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:02.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:14:02.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBKBJVpmI5gKxAA+IDWqRSrgr8mFh1KjjLweQ== --osd-uuid 3d9c1ab6-27ec-41e0-aa2c-ebea48724287 2026-02-18T00:14:02.989 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:02.987+0000 7fc0caf05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:02.991 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:02.989+0000 7fc0caf05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:02.991 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:02.990+0000 7fc0caf05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:02.992 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:02.990+0000 7fc0caf05900 -1 bdev(0x5626b60b6c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:02.992 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:02.990+0000 7fc0caf05900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:14:03.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:14:03.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:03.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:14:03.316 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:14:03.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:03.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:14:03.652 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:14:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:03.670 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:03.667+0000 7f3d584a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:03.671 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:03.668+0000 7f3d584a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:03.672 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:03.669+0000 7f3d584a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:03.802 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:03.799+0000 7f3d584a1900 -1 Falling back to public interface 2026-02-18T00:14:03.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:03.877 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:03.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:03.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:14:04.080 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:04.077+0000 7f3d584a1900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:14:04.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:05.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:05.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:05.108 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:05.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:05.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:05.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:14:05.333 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1369387761,v1:127.0.0.1:6811/1369387761] [v2:127.0.0.1:6812/1369387761,v1:127.0.0.1:6813/1369387761] exists,up 3d9c1ab6-27ec-41e0-aa2c-ebea48724287 2026-02-18T00:14:05.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:05.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:05.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:05.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:05.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:05.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:05.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a81c54d5-8864-4d58-b210-0a48c1dd579d 2026-02-18T00:14:05.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 a81c54d5-8864-4d58-b210-0a48c1dd579d' 2026-02-18T00:14:05.341 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 a81c54d5-8864-4d58-b210-0a48c1dd579d 2026-02-18T00:14:05.341 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:05.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBNBJVpuDvDFBAAJbjK+GMMs6B/KfeDz9y4qA== 2026-02-18T00:14:05.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBNBJVpuDvDFBAAJbjK+GMMs6B/KfeDz9y4qA=="}' 2026-02-18T00:14:05.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a81c54d5-8864-4d58-b210-0a48c1dd579d -i td/test-erasure-eio/2/new.json 2026-02-18T00:14:05.577 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:14:05.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:14:05.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBNBJVpuDvDFBAAJbjK+GMMs6B/KfeDz9y4qA== --osd-uuid a81c54d5-8864-4d58-b210-0a48c1dd579d 2026-02-18T00:14:05.607 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:05.604+0000 7f735701b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:05.608 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:05.605+0000 7f735701b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:05.609 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:05.606+0000 7f735701b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:05.610 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:05.606+0000 7f735701b900 -1 bdev(0x5639bbdf6c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:05.610 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:05.606+0000 7f735701b900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:14:05.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:14:05.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:05.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:14:05.928 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:14:05.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:06.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:14:06.255 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:14:06.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:06.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:06.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:06.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:06.274 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:06.271+0000 7ff19c7a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:06.275 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:06.272+0000 7ff19c7a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:06.276 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:06.273+0000 7ff19c7a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:06.403 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:06.400+0000 7ff19c7a8900 -1 Falling back to public interface 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:06.485 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:06.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:06.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:06.708 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:06.705+0000 7ff19c7a8900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:14:06.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:07.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:07.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:07.721 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:07.721 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:07.721 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:07.721 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:07.947 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/128031421,v1:127.0.0.1:6819/128031421] [v2:127.0.0.1:6820/128031421,v1:127.0.0.1:6821/128031421] exists,up a81c54d5-8864-4d58-b210-0a48c1dd579d 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:07.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:07.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a5b49959-7735-4d6c-a506-45c15146fe75 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 a5b49959-7735-4d6c-a506-45c15146fe75' 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 a5b49959-7735-4d6c-a506-45c15146fe75 2026-02-18T00:14:07.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:07.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBPBJVpmSJeORAAel6uROOmY5nfM/68APbzTw== 2026-02-18T00:14:07.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBPBJVpmSJeORAAel6uROOmY5nfM/68APbzTw=="}' 2026-02-18T00:14:07.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a5b49959-7735-4d6c-a506-45c15146fe75 -i td/test-erasure-eio/3/new.json 2026-02-18T00:14:08.195 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:14:08.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:14:08.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBPBJVpmSJeORAAel6uROOmY5nfM/68APbzTw== --osd-uuid a5b49959-7735-4d6c-a506-45c15146fe75 2026-02-18T00:14:08.223 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.220+0000 7f781fd59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:08.225 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.222+0000 7f781fd59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:08.226 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.223+0000 7f781fd59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:08.227 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.223+0000 7f781fd59900 -1 bdev(0x56314508cc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:08.227 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.223+0000 7f781fd59900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:14:08.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:14:08.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:08.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:14:08.557 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:14:08.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:08.871 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:14:08.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:14:08.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:08.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:08.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:08.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:08.890 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.886+0000 7fa7546d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:08.891 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.888+0000 7fa7546d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:08.892 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:08.889+0000 7fa7546d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:09.031 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:09.028+0000 7fa7546d7900 -1 Falling back to public interface 2026-02-18T00:14:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:14:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:14:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:09.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:09.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:09.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:09.098 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:09.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:09.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:14:09.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:09.426 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:09.423+0000 7fa7546d7900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:14:10.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:10.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:10.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:10.324 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:10.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:10.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:14:10.551 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2703997701,v1:127.0.0.1:6827/2703997701] [v2:127.0.0.1:6828/2703997701,v1:127.0.0.1:6829/2703997701] exists,up a5b49959-7735-4d6c-a506-45c15146fe75 2026-02-18T00:14:10.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:10.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:10.556 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:10.557 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:10.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f1af26ef-dc95-4759-8a20-8727e51a1732 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 f1af26ef-dc95-4759-8a20-8727e51a1732' 2026-02-18T00:14:10.559 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 f1af26ef-dc95-4759-8a20-8727e51a1732 2026-02-18T00:14:10.560 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:10.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBSBJVpYei1IRAAvBz3nqjOBCSGqttUGRqAQw== 2026-02-18T00:14:10.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBSBJVpYei1IRAAvBz3nqjOBCSGqttUGRqAQw=="}' 2026-02-18T00:14:10.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f1af26ef-dc95-4759-8a20-8727e51a1732 -i td/test-erasure-eio/4/new.json 2026-02-18T00:14:10.804 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:14:10.812 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:14:10.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBSBJVpYei1IRAAvBz3nqjOBCSGqttUGRqAQw== --osd-uuid f1af26ef-dc95-4759-8a20-8727e51a1732 2026-02-18T00:14:10.833 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:10.830+0000 7f30ed0e4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:10.834 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:10.831+0000 7f30ed0e4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:10.835 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:10.833+0000 7f30ed0e4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:10.836 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:10.833+0000 7f30ed0e4900 -1 bdev(0x55e9767c8c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:10.836 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:10.833+0000 7f30ed0e4900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:14:11.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:14:11.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:11.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:14:11.164 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:14:11.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:11.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:14:11.487 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:14:11.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:11.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:11.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:11.488 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:11.505 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:11.502+0000 7fed5d388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:11.507 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:11.504+0000 7fed5d388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:11.507 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:11.504+0000 7fed5d388900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:11.629 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:11.626+0000 7fed5d388900 -1 Falling back to public interface 2026-02-18T00:14:11.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:14:11.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:11.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:14:11.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:11.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:11.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:11.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:11.713 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:11.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:11.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:14:11.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:11.970 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:11.967+0000 7fed5d388900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:14:12.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:12.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:12.950 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:12.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:12.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:12.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:14:13.179 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 36 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4243179906,v1:127.0.0.1:6835/4243179906] [v2:127.0.0.1:6836/4243179906,v1:127.0.0.1:6837/4243179906] exists,up f1af26ef-dc95-4759-8a20-8727e51a1732 2026-02-18T00:14:13.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:13.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:13.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:13.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-18T00:14:13.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:13.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=79466e5e-1336-4200-b2e1-7e595fd311bb 2026-02-18T00:14:13.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 79466e5e-1336-4200-b2e1-7e595fd311bb' 2026-02-18T00:14:13.187 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 79466e5e-1336-4200-b2e1-7e595fd311bb 2026-02-18T00:14:13.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:13.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBVBJVp26KfCxAAonFPjNiiw1sEBMlqrMM3Ww== 2026-02-18T00:14:13.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBVBJVp26KfCxAAonFPjNiiw1sEBMlqrMM3Ww=="}' 2026-02-18T00:14:13.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 79466e5e-1336-4200-b2e1-7e595fd311bb -i td/test-erasure-eio/5/new.json 2026-02-18T00:14:13.427 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:14:13.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-18T00:14:13.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBVBJVp26KfCxAAonFPjNiiw1sEBMlqrMM3Ww== --osd-uuid 79466e5e-1336-4200-b2e1-7e595fd311bb 2026-02-18T00:14:13.456 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:13.453+0000 7f3fd01e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:13.457 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:13.454+0000 7f3fd01e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:13.458 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:13.455+0000 7f3fd01e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:13.459 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:13.456+0000 7f3fd01e0900 -1 bdev(0x561c00ee4c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:13.459 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:13.456+0000 7f3fd01e0900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-18T00:14:13.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-18T00:14:13.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:13.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:14:13.791 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:14:13.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:14.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:14:14.104 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:14:14.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:14.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:14.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:14.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:14.123 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:14.120+0000 7f0860821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:14.124 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:14.121+0000 7f0860821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:14.125 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:14.122+0000 7f0860821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:14.278 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:14.275+0000 7f0860821900 -1 Falling back to public interface 2026-02-18T00:14:14.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:14:14.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:14.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:14:14.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:14.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:14.581 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:14.578+0000 7f0860821900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:14:15.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:15.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:15.551 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:15.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:15.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:15.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:14:15.779 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 45 up_thru 46 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/761729329,v1:127.0.0.1:6843/761729329] [v2:127.0.0.1:6844/761729329,v1:127.0.0.1:6845/761729329] exists,up 79466e5e-1336-4200-b2e1-7e595fd311bb 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:15.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:15.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:15.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:15.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:15.781 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:15.781 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-18T00:14:15.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:15.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c98b2ab4-cf27-47b4-b07c-b8388ecf65fd 2026-02-18T00:14:15.783 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 c98b2ab4-cf27-47b4-b07c-b8388ecf65fd 2026-02-18T00:14:15.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 c98b2ab4-cf27-47b4-b07c-b8388ecf65fd' 2026-02-18T00:14:15.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:15.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBXBJVpbrBWLxAAMQkB/VpYeasQO5rcW/IZnA== 2026-02-18T00:14:15.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBXBJVpbrBWLxAAMQkB/VpYeasQO5rcW/IZnA=="}' 2026-02-18T00:14:15.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c98b2ab4-cf27-47b4-b07c-b8388ecf65fd -i td/test-erasure-eio/6/new.json 2026-02-18T00:14:16.025 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:14:16.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-18T00:14:16.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBXBJVpbrBWLxAAMQkB/VpYeasQO5rcW/IZnA== --osd-uuid c98b2ab4-cf27-47b4-b07c-b8388ecf65fd 2026-02-18T00:14:16.054 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.051+0000 7fe7b5d83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.055 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.052+0000 7fe7b5d83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.056 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.053+0000 7fe7b5d83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.057 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.054+0000 7fe7b5d83900 -1 bdev(0x561cd7de6c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:16.057 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.054+0000 7fe7b5d83900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-18T00:14:16.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-18T00:14:16.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:16.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:14:16.395 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:14:16.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:16.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:14:16.711 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:14:16.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:16.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:16.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:16.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:16.730 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.726+0000 7f4b8edc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.731 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.728+0000 7f4b8edc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.732 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.729+0000 7f4b8edc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:16.864 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:16.860+0000 7f4b8edc7900 -1 Falling back to public interface 2026-02-18T00:14:16.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:14:16.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:16.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:14:16.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:16.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:16.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:16.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:16.936 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:16.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:16.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:14:17.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:17.230 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:17.227+0000 7f4b8edc7900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:14:18.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:18.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:18.166 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:18.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:18.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:18.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:14:18.392 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 53 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3808731819,v1:127.0.0.1:6851/3808731819] [v2:127.0.0.1:6852/3808731819,v1:127.0.0.1:6853/3808731819] exists,up c98b2ab4-cf27-47b4-b07c-b8388ecf65fd 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:14:18.394 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:18.395 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:18.395 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:18.395 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:14:18.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:14:18.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:14:18.441 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:14:18.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:14:18.448 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:14:01.498+0000 7f68dfb62900 0 load: jerasure load: lrc 2026-02-18T00:14:18.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:506: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:508: TEST_ec_recovery_multiple_objects_eio: local poolname=pool-jerasure 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:509: TEST_ec_recovery_multiple_objects_eio: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:14:18.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:14:18.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:14:18.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:14:19.113 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:14:19.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:14:20.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:14:20.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:14:20.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:14:20.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:14:20.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:14:20.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:14:20.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:14:20.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:14:20.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:14:20.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:14:20.212 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:14:20.435 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:14:20.436 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:14:20.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:14:20.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:14:20.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-18T00:14:20.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-18T00:14:20.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-18T00:14:20.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.500 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:14:20.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-18T00:14:20.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-18T00:14:20.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854' 2026-02-18T00:14:20.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.565 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:14:20.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378629 2026-02-18T00:14:20.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378629 2026-02-18T00:14:20.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629' 2026-02-18T00:14:20.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.630 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:14:20.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116997 2026-02-18T00:14:20.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116997 2026-02-18T00:14:20.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997' 2026-02-18T00:14:20.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:14:20.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-18T00:14:20.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-18T00:14:20.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822660' 2026-02-18T00:14:20.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.759 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:14:20.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528325 2026-02-18T00:14:20.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528325 2026-02-18T00:14:20.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822660 5-193273528325' 2026-02-18T00:14:20.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:20.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:14:20.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=227633266691 2026-02-18T00:14:20.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 227633266691 2026-02-18T00:14:20.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822660 5-193273528325 6-227633266691' 2026-02-18T00:14:20.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:20.889 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-18T00:14:20.890 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:20.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:14:20.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-18T00:14:20.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:20.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-18T00:14:20.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-18T00:14:20.892 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803782 2026-02-18T00:14:20.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:14:21.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-18T00:14:21.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:14:22.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:14:22.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:14:22.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-18T00:14:22.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:22.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574854 2026-02-18T00:14:22.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:22.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:14:22.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574854 2026-02-18T00:14:22.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:22.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-18T00:14:22.348 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574854' 2026-02-18T00:14:22.348 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574854 2026-02-18T00:14:22.348 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:14:22.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-18T00:14:22.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:22.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378629 2026-02-18T00:14:22.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:22.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:14:22.571 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378629 2026-02-18T00:14:22.571 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:22.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378629 2026-02-18T00:14:22.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378629' 2026-02-18T00:14:22.572 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 81604378629 2026-02-18T00:14:22.572 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:14:22.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378629 -lt 81604378629 2026-02-18T00:14:22.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:22.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116997 2026-02-18T00:14:22.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:22.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:14:22.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116997 2026-02-18T00:14:22.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:22.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116997 2026-02-18T00:14:22.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116997' 2026-02-18T00:14:22.797 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116997 2026-02-18T00:14:22.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:14:23.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116997 -lt 115964116997 2026-02-18T00:14:23.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:23.020 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822660 2026-02-18T00:14:23.020 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:23.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:14:23.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822660 2026-02-18T00:14:23.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:23.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822660 2026-02-18T00:14:23.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822660' 2026-02-18T00:14:23.023 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 154618822660 2026-02-18T00:14:23.023 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:14:23.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-18T00:14:23.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:23.257 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-193273528325 2026-02-18T00:14:23.257 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:23.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:14:23.258 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-193273528325 2026-02-18T00:14:23.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:23.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528325 2026-02-18T00:14:23.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 193273528325' 2026-02-18T00:14:23.260 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 193273528325 2026-02-18T00:14:23.260 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:14:23.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528325 -lt 193273528325 2026-02-18T00:14:23.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:23.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-227633266691 2026-02-18T00:14:23.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:23.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:14:23.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-227633266691 2026-02-18T00:14:23.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=227633266691 2026-02-18T00:14:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 227633266691' 2026-02-18T00:14:23.487 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 227633266691 2026-02-18T00:14:23.487 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:14:23.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 227633266691 -lt 227633266691 2026-02-18T00:14:23.712 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:14:23.713 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:23.713 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:24.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:14:24.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:24.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:24.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:14:24.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:24.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:24.260 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:24.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:14:24.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:14:24.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:14:24.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:511: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:14:24.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:24.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:512: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:14:24.595 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:14:24.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:24.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:513: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:14:24.615 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:516: TEST_ec_recovery_multiple_objects_eio: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:14:24.635 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:14:24.636 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:14:24.864 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:14:24.865 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:14:24.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:14:24.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:14:24.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:14:24.868 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:14:24.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:14:24.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:24.917 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:24.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:24.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:14:24.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:14:24.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-18T00:14:24.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:517: TEST_ec_recovery_multiple_objects_eio: ceph osd out 0 2026-02-18T00:14:25.246 INFO:tasks.workunit.client.0.trial061.stderr:osd.0 is already out. 2026-02-18T00:14:25.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:520: TEST_ec_recovery_multiple_objects_eio: wait_for_clean 2026-02-18T00:14:25.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:14:25.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:14:25.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:14:25.255 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:14:25.256 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:14:25.256 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:14:25.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:14:25.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:14:25.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:14:25.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:14:25.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:14:25.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:14:25.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:14:25.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:14:25.341 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:14:25.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:14:25.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:14:25.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:14:25.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:14:25.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.634 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:14:25.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-18T00:14:25.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-18T00:14:25.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857' 2026-02-18T00:14:25.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.699 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:14:25.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378632 2026-02-18T00:14:25.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378632 2026-02-18T00:14:25.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632' 2026-02-18T00:14:25.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.765 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:14:25.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117000 2026-02-18T00:14:25.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117000 2026-02-18T00:14:25.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964117000' 2026-02-18T00:14:25.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:14:25.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822663 2026-02-18T00:14:25.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822663 2026-02-18T00:14:25.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964117000 4-154618822663' 2026-02-18T00:14:25.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:14:25.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528328 2026-02-18T00:14:25.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528328 2026-02-18T00:14:25.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964117000 4-154618822663 5-193273528328' 2026-02-18T00:14:25.955 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:25.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:14:26.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=227633266694 2026-02-18T00:14:26.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 227633266694 2026-02-18T00:14:26.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964117000 4-154618822663 5-193273528328 6-227633266694' 2026-02-18T00:14:26.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:26.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:14:26.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:26.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:14:26.024 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:14:26.024 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:26.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:14:26.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:14:26.025 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803785 2026-02-18T00:14:26.025 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:14:26.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 0 -lt 25769803785 2026-02-18T00:14:26.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:14:27.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:14:27.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:14:27.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-18T00:14:27.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:27.477 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574857 2026-02-18T00:14:27.477 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:27.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:14:27.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574857 2026-02-18T00:14:27.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:27.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-18T00:14:27.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574857' 2026-02-18T00:14:27.480 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574857 2026-02-18T00:14:27.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:14:27.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-18T00:14:27.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:27.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378632 2026-02-18T00:14:27.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:27.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:14:27.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378632 2026-02-18T00:14:27.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:27.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378632 2026-02-18T00:14:27.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378632' 2026-02-18T00:14:27.709 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 81604378632 2026-02-18T00:14:27.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:14:27.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378632 -lt 81604378632 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964117000 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964117000 2026-02-18T00:14:27.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:27.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964117000 2026-02-18T00:14:27.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964117000' 2026-02-18T00:14:27.935 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964117000 2026-02-18T00:14:27.935 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:14:28.159 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964117000 -lt 115964117000 2026-02-18T00:14:28.159 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:28.160 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822663 2026-02-18T00:14:28.160 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:28.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:14:28.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822663 2026-02-18T00:14:28.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:28.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822663 2026-02-18T00:14:28.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822663' 2026-02-18T00:14:28.163 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 154618822663 2026-02-18T00:14:28.163 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:14:28.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822663 -lt 154618822663 2026-02-18T00:14:28.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:28.388 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-193273528328 2026-02-18T00:14:28.388 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:28.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:14:28.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-193273528328 2026-02-18T00:14:28.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528328 2026-02-18T00:14:28.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 193273528328' 2026-02-18T00:14:28.390 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 193273528328 2026-02-18T00:14:28.390 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:14:28.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528328 -lt 193273528328 2026-02-18T00:14:28.613 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:28.613 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-227633266694 2026-02-18T00:14:28.613 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:28.614 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:14:28.614 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-227633266694 2026-02-18T00:14:28.615 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:28.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=227633266694 2026-02-18T00:14:28.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 227633266694' 2026-02-18T00:14:28.616 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 227633266694 2026-02-18T00:14:28.616 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:14:28.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 227633266694 -lt 227633266694 2026-02-18T00:14:28.839 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:14:28.840 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:28.840 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:29.160 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:29.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:29.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:14:29.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:29.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:29.381 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:29.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-18T00:14:29.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' -1 2026-02-18T00:14:29.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-18T00:14:29.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=4 2026-02-18T00:14:29.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:14:29.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-18T00:14:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:29.796 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:30.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:14:30.015 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:30.015 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:30.015 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' 4 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:14:30.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:14:30.330 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:14:30.330 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:14:30.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:14:30.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:14:30.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-18T00:14:30.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:14:30.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-18T00:14:30.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:14:30.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:30.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:30.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:30.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:30.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:30.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:30.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:31.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-18T00:14:31.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:31.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:31.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:31.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-18T00:14:31.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' 4 2026-02-18T00:14:31.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-18T00:14:31.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-18T00:14:31.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-18T00:14:31.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-18T00:14:31.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-18T00:14:31.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-18T00:14:31.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-18T00:14:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-18T00:14:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-18T00:14:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 13 )) 2026-02-18T00:14:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-18T00:14:31.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-18T00:14:32.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-18T00:14:32.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:32.335 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:14:32.336 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:32.336 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:32.336 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:32.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:522: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:14:32.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-18T00:14:32.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:14:32.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:523: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:14:32.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-18T00:14:32.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:14:32.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:524: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:14:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:14:32.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-18T00:14:32.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:14:32.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:14:32.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:526: TEST_ec_recovery_multiple_objects_eio: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:14:32.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:14:32.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:14:32.983 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:14:32.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:14:33.269 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:14:33.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:14:33.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:14:33.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:14:33.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:14:33.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:14:33.280 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:14:33.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:14:33.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:14:33.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:14:33.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:14:33.390 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:14:33.390 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:14:33.391 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:14:33.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:14:33.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:14:33.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:14:33.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:14:33.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:14:33.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:14:33.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:14:33.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:14:33.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:14:33.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:14:33.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:14:33.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:14:33.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:14:33.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:14:33.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:14:33.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:14:33.415 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:14:33.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:14:33.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:14:33.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:14:33.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:14:33.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:14:33.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:14:33.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:14:33.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:14:33.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:14:33.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:14:33.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:14:33.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.420 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:14:33.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:14:33.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:14:33.421 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:14:33.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:14:33.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.422 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:14:33.423 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:14:33.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:14:33.445 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:33.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:14:33.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:14:33.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:14:33.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:14:33.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:14:33.473 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:14:33.474 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:14:33.475 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:14:33.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:14:33.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:14:33.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:14:33.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:14:33.521 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:14:33.521 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:14:33.521 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:14:33.521 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:14:33.522 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:14:33.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:14:33.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:14:33.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:14:33.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:14:33.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:14:33.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:14:33.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:33.669 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:33.670 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:33.670 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:14:33.670 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:14:33.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:14:33.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:14:33.783 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:14:33.789 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:14:34.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:14:34.834 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:14:34.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:14:34.840 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:14:33.463+0000 7f5327e11d80 0 load: jerasure load: lrc 2026-02-18T00:14:34.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_unfound td/test-erasure-eio 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:629: TEST_ec_recovery_unfound: local dir=td/test-erasure-eio 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:630: TEST_ec_recovery_unfound: local objname=myobject 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:631: TEST_ec_recovery_unfound: local lastobj=100 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:633: TEST_ec_recovery_unfound: local testobj=obj75 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:635: TEST_ec_recovery_unfound: ORIG_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:636: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:638: TEST_ec_recovery_unfound: setup_osds 5 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-18T00:14:34.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:14:34.843 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-18T00:14:34.846 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-18T00:14:34.846 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:14:34.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:34.848 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6bff6caa-65de-47ec-80c3-1f911ef63bde 2026-02-18T00:14:34.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6bff6caa-65de-47ec-80c3-1f911ef63bde' 2026-02-18T00:14:34.850 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 6bff6caa-65de-47ec-80c3-1f911ef63bde 2026-02-18T00:14:34.850 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:34.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBqBJVpWDsxMxAAPGRTfCjnJXvlBnIBspMbxg== 2026-02-18T00:14:34.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBqBJVpWDsxMxAAPGRTfCjnJXvlBnIBspMbxg=="}' 2026-02-18T00:14:34.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6bff6caa-65de-47ec-80c3-1f911ef63bde -i td/test-erasure-eio/0/new.json 2026-02-18T00:14:34.969 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:34.976 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:14:34.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBqBJVpWDsxMxAAPGRTfCjnJXvlBnIBspMbxg== --osd-uuid 6bff6caa-65de-47ec-80c3-1f911ef63bde 2026-02-18T00:14:34.998 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:34.996+0000 7fc37ccaf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.000 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:34.997+0000 7fc37ccaf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.001 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:34.998+0000 7fc37ccaf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.001 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:34.998+0000 7fc37ccaf900 -1 bdev(0x55fced99ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:35.001 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:34.998+0000 7fc37ccaf900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:14:35.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:14:35.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:35.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:14:35.409 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:14:35.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:35.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:35.539 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:35.536+0000 7fced9a5b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.541 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:35.538+0000 7fced9a5b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.542 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:35.539+0000 7fced9a5b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:35.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:35.623 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:35.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:35.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:14:35.717 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:35.714+0000 7fced9a5b900 -1 Falling back to public interface 2026-02-18T00:14:35.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:35.973 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:35.970+0000 7fced9a5b900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:14:36.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:36.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:36.728 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:36.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:36.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:36.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:14:36.956 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/774456872,v1:127.0.0.1:6803/774456872] [v2:127.0.0.1:6804/774456872,v1:127.0.0.1:6805/774456872] exists,up 6bff6caa-65de-47ec-80c3-1f911ef63bde 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:36.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:36.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:36.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0021d7a0-376a-41c1-a82b-76293f6fa73c 2026-02-18T00:14:36.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0021d7a0-376a-41c1-a82b-76293f6fa73c' 2026-02-18T00:14:36.964 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 0021d7a0-376a-41c1-a82b-76293f6fa73c 2026-02-18T00:14:36.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:36.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBsBJVpDpD/ORAAgM4d7pwdlU4RSwqrJ0oyIw== 2026-02-18T00:14:36.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBsBJVpDpD/ORAAgM4d7pwdlU4RSwqrJ0oyIw=="}' 2026-02-18T00:14:36.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0021d7a0-376a-41c1-a82b-76293f6fa73c -i td/test-erasure-eio/1/new.json 2026-02-18T00:14:37.209 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:37.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:14:37.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBsBJVpDpD/ORAAgM4d7pwdlU4RSwqrJ0oyIw== --osd-uuid 0021d7a0-376a-41c1-a82b-76293f6fa73c 2026-02-18T00:14:37.239 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.236+0000 7fdd523a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:37.240 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.237+0000 7fdd523a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:37.241 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.238+0000 7fdd523a8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:37.242 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.239+0000 7fdd523a8900 -1 bdev(0x5643247b0c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:37.242 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.239+0000 7fdd523a8900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:14:37.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:14:37.563 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:37.564 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:14:37.564 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:14:37.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:37.883 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:14:37.883 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:14:37.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:37.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:37.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:37.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:37.904 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.901+0000 7f59492d0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:37.905 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.902+0000 7f59492d0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:37.906 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:37.903+0000 7f59492d0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:38.036 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:38.033+0000 7f59492d0900 -1 Falling back to public interface 2026-02-18T00:14:38.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:14:38.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:38.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:14:38.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:38.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:38.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:38.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:38.113 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:38.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:38.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:14:38.315 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:38.312+0000 7f59492d0900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:14:38.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:39.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:39.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:39.343 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:39.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:39.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:39.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:14:39.569 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/677411860,v1:127.0.0.1:6811/677411860] [v2:127.0.0.1:6812/677411860,v1:127.0.0.1:6813/677411860] exists,up 0021d7a0-376a-41c1-a82b-76293f6fa73c 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:39.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:39.574 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:39.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aa3ee528-de14-42ee-bf06-d2e09805ca5c 2026-02-18T00:14:39.576 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 aa3ee528-de14-42ee-bf06-d2e09805ca5c 2026-02-18T00:14:39.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 aa3ee528-de14-42ee-bf06-d2e09805ca5c' 2026-02-18T00:14:39.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:39.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBvBJVpcxneIhAAlOR3MRTyUsWl/mCEkSu6Wg== 2026-02-18T00:14:39.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBvBJVpcxneIhAAlOR3MRTyUsWl/mCEkSu6Wg=="}' 2026-02-18T00:14:39.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aa3ee528-de14-42ee-bf06-d2e09805ca5c -i td/test-erasure-eio/2/new.json 2026-02-18T00:14:39.821 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:14:39.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:14:39.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBvBJVpcxneIhAAlOR3MRTyUsWl/mCEkSu6Wg== --osd-uuid aa3ee528-de14-42ee-bf06-d2e09805ca5c 2026-02-18T00:14:39.852 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:39.849+0000 7f5b09c7f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:39.854 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:39.851+0000 7f5b09c7f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:39.855 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:39.852+0000 7f5b09c7f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:39.856 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:39.853+0000 7f5b09c7f900 -1 bdev(0x559c417acc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:39.856 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:39.853+0000 7f5b09c7f900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:14:40.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:14:40.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:40.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:14:40.169 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:14:40.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:40.484 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:14:40.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:14:40.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:40.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:40.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:40.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:40.506 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:40.503+0000 7f138b0f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:40.507 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:40.504+0000 7f138b0f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:40.508 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:40.505+0000 7f138b0f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:40.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:40.626+0000 7f138b0f1900 -1 Falling back to public interface 2026-02-18T00:14:40.712 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:40.713 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:40.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:40.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:40.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:40.975 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:40.972+0000 7f138b0f1900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:14:41.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:41.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:41.946 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:41.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:41.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:41.947 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:42.177 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1405802853,v1:127.0.0.1:6819/1405802853] [v2:127.0.0.1:6820/1405802853,v1:127.0.0.1:6821/1405802853] exists,up aa3ee528-de14-42ee-bf06-d2e09805ca5c 2026-02-18T00:14:42.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:42.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:42.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:14:42.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:42.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:42.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7550df62-f0b1-4afb-bb58-f7cfa8d3239e 2026-02-18T00:14:42.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7550df62-f0b1-4afb-bb58-f7cfa8d3239e' 2026-02-18T00:14:42.186 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 7550df62-f0b1-4afb-bb58-f7cfa8d3239e 2026-02-18T00:14:42.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:42.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQByBJVpfM9/CxAAqWEtPA6aVqMo15v7XIKMVA== 2026-02-18T00:14:42.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQByBJVpfM9/CxAAqWEtPA6aVqMo15v7XIKMVA=="}' 2026-02-18T00:14:42.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7550df62-f0b1-4afb-bb58-f7cfa8d3239e -i td/test-erasure-eio/3/new.json 2026-02-18T00:14:42.425 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:14:42.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:14:42.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQByBJVpfM9/CxAAqWEtPA6aVqMo15v7XIKMVA== --osd-uuid 7550df62-f0b1-4afb-bb58-f7cfa8d3239e 2026-02-18T00:14:42.455 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:42.453+0000 7f2419a93900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:42.457 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:42.454+0000 7f2419a93900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:42.458 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:42.455+0000 7f2419a93900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:42.458 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:42.455+0000 7f2419a93900 -1 bdev(0x55cf1ae96c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:42.459 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:42.455+0000 7f2419a93900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:14:42.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:14:42.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:42.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:14:42.778 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:14:42.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:43.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:14:43.100 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:14:43.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:43.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:43.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:43.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:43.121 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:43.118+0000 7f8fa95d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:43.122 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:43.119+0000 7f8fa95d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:43.123 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:43.120+0000 7f8fa95d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:43.282 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:43.278+0000 7f8fa95d8900 -1 Falling back to public interface 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:43.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:43.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:43.328 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:43.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:43.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:14:43.557 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:43.597 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:43.594+0000 7f8fa95d8900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:14:44.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:44.558 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:44.559 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:44.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:44.559 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:44.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:14:44.787 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/805163111,v1:127.0.0.1:6827/805163111] [v2:127.0.0.1:6828/805163111,v1:127.0.0.1:6829/805163111] exists,up 7550df62-f0b1-4afb-bb58-f7cfa8d3239e 2026-02-18T00:14:44.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:14:44.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:44.792 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:44.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6489a761-4e6d-4c6b-a078-2d3a1f02a8f7 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 6489a761-4e6d-4c6b-a078-2d3a1f02a8f7' 2026-02-18T00:14:44.794 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 6489a761-4e6d-4c6b-a078-2d3a1f02a8f7 2026-02-18T00:14:44.795 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:14:44.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB0BJVptprnLxAAxPVKNVNSnBKA68+TcaqW8g== 2026-02-18T00:14:44.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB0BJVptprnLxAAxPVKNVNSnBKA68+TcaqW8g=="}' 2026-02-18T00:14:44.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6489a761-4e6d-4c6b-a078-2d3a1f02a8f7 -i td/test-erasure-eio/4/new.json 2026-02-18T00:14:45.036 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:14:45.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:14:45.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB0BJVptprnLxAAxPVKNVNSnBKA68+TcaqW8g== --osd-uuid 6489a761-4e6d-4c6b-a078-2d3a1f02a8f7 2026-02-18T00:14:45.068 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.066+0000 7f77176ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.070 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.067+0000 7f77176ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.070 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.068+0000 7f77176ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.071 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.068+0000 7f77176ba900 -1 bdev(0x557843820c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:14:45.071 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.068+0000 7f77176ba900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:14:45.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:14:45.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:14:45.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:14:45.398 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:14:45.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:14:45.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:14:45.725 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:14:45.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:45.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:14:45.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:14:45.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:14:45.745 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.743+0000 7f307ca0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.746 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.745+0000 7f307ca0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.747 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.746+0000 7f307ca0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:45.921 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:45.920+0000 7f307ca0d900 -1 Falling back to public interface 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:45.957 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:45.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:45.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:45.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:14:46.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:46.258 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:46.256+0000 7f307ca0d900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:14:47.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:47.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:47.187 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:47.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:47.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:47.188 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:14:47.415 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 34 up_thru 35 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1027575183,v1:127.0.0.1:6835/1027575183] [v2:127.0.0.1:6836/1027575183,v1:127.0.0.1:6837/1027575183] exists,up 6489a761-4e6d-4c6b-a078-2d3a1f02a8f7 2026-02-18T00:14:47.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:14:47.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:14:47.463 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:14:47.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:14:47.468 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:14:35.717+0000 7fced9a5b900 0 load: jerasure load: lrc 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: CEPH_ARGS='--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:641: TEST_ec_recovery_unfound: local poolname=pool-jerasure 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:642: TEST_ec_recovery_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:14:47.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:14:47.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:14:47.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:14:48.127 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:14:48.135 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:14:49.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:14:49.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:14:49.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:14:49.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:14:49.138 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:14:49.138 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:14:49.138 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:14:49.138 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:14:49.138 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:14:49.139 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:14:49.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:4' 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:14:49.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:49.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:14:49.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-18T00:14:49.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-18T00:14:49.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-18T00:14:49.519 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:49.520 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:14:49.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-18T00:14:49.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-18T00:14:49.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853' 2026-02-18T00:14:49.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:49.584 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:14:49.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378628 2026-02-18T00:14:49.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378628 2026-02-18T00:14:49.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378628' 2026-02-18T00:14:49.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:49.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:14:49.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149699 2026-02-18T00:14:49.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149699 2026-02-18T00:14:49.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378628 3-111669149699' 2026-02-18T00:14:49.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:14:49.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:14:49.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-18T00:14:49.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-18T00:14:49.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378628 3-111669149699 4-146028888067' 2026-02-18T00:14:49.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:49.779 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-18T00:14:49.779 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:49.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:14:49.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-18T00:14:49.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:49.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-18T00:14:49.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-18T00:14:49.781 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803781 2026-02-18T00:14:49.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:14:50.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803781 2026-02-18T00:14:50.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:50.004 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574853 2026-02-18T00:14:50.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:50.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:14:50.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574853 2026-02-18T00:14:50.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:50.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574853 2026-02-18T00:14:50.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574853' 2026-02-18T00:14:50.007 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574853 2026-02-18T00:14:50.007 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:14:50.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-18T00:14:50.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:50.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378628 2026-02-18T00:14:50.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:50.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:14:50.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378628 2026-02-18T00:14:50.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:50.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378628 2026-02-18T00:14:50.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378628' 2026-02-18T00:14:50.239 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 81604378628 2026-02-18T00:14:50.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:14:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378628 -lt 81604378628 2026-02-18T00:14:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:50.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149699 2026-02-18T00:14:50.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:50.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:14:50.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149699 2026-02-18T00:14:50.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:50.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149699 2026-02-18T00:14:50.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149699' 2026-02-18T00:14:50.466 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149699 2026-02-18T00:14:50.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:14:50.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149697 -lt 111669149699 2026-02-18T00:14:50.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:14:51.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:14:51.693 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:14:51.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149700 -lt 111669149699 2026-02-18T00:14:51.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:14:51.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888067 2026-02-18T00:14:51.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:14:51.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:14:51.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888067 2026-02-18T00:14:51.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:14:51.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888067 2026-02-18T00:14:51.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888067' 2026-02-18T00:14:51.921 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888067 2026-02-18T00:14:51.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:14:52.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-18T00:14:52.147 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:14:52.147 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:52.147 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:52.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:14:52.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:14:52.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:14:52.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:14:52.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:14:52.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:14:52.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:14:52.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:14:52.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:14:52.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:14:52.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:644: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-18T00:14:53.212 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:14:53.212 INFO:tasks.workunit.client.0.trial061.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:48.299387+0000 0'0 41:16 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-18T00:14:48.062470+0000 0'0 2026-02-18T00:14:48.062470+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:26:25.281679+0000 0 0 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.682854+0000 0'0 41:22 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:31:09.625234+0000 0 0 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.354679+0000 0'0 41:98 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:06:08.986762+0000 0 0 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.499630+0000 0'0 41:22 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T10:04:14.552336+0000 0 0 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:41.650382+0000 0'0 41:62 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:13:42.150166+0000 0 0 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:14:53.213 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:646: TEST_ec_recovery_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:53.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:14:53.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:53.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:14:53.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:14:53.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:14:53.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:53.240 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: get_osds pool-jerasure myobject 2026-02-18T00:14:53.241 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:14:53.241 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:14:53.241 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:14:53.241 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:14:53.468 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:14:53.468 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: local -a initial_osds 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:649: TEST_ec_recovery_unfound: local last_osd=2 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:650: TEST_ec_recovery_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:14:53.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:14:53.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:14:53.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:14:53.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:14:53.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:651: TEST_ec_recovery_unfound: ceph osd down 2 2026-02-18T00:14:54.006 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already down. 2026-02-18T00:14:54.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:652: TEST_ec_recovery_unfound: ceph osd out 2 2026-02-18T00:14:54.255 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already out. 2026-02-18T00:14:54.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:654: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:48.299387+0000 0'0 41:16 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-18T00:14:48.062470+0000 0'0 2026-02-18T00:14:48.062470+0000 0 0 periodic scrub scheduled @ 2026-02-19T02:26:25.281679+0000 0 0 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.682854+0000 0'0 41:22 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:31:09.625234+0000 0 0 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.354679+0000 0'0 41:98 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:06:08.986762+0000 0 0 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.499630+0000 0'0 41:22 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T10:04:14.552336+0000 0 0 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:41.650382+0000 0'0 41:62 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:13:42.150166+0000 0 0 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:14:54.476 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:14:54.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:656: TEST_ec_recovery_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-18T00:14:54.484 INFO:tasks.workunit.client.0.trial061.stderr:4+0 records in 2026-02-18T00:14:54.485 INFO:tasks.workunit.client.0.trial061.stderr:4+0 records out 2026-02-18T00:14:54.485 INFO:tasks.workunit.client.0.trial061.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.7757e-05 s, 60.5 MB/s 2026-02-18T00:14:54.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: seq 1 100 2026-02-18T00:14:54.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.562 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.618 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.638 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.657 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.657 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.768 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:54.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:54.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.136 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.287 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.287 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.811 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.812 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.867 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:55.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:55.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.223 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:14:56.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-18T00:14:56.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:662: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 0 2026-02-18T00:14:56.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:14:56.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:14:56.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj75 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj75 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj75 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-18T00:14:56.354 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:2147483647' 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:14:56.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:14:56.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:56.578 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:56.579 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:14:56.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:14:56.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:14:56.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:56.631 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:56.632 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:56.632 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:14:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:14:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure obj75 0 2026-02-18T00:14:56.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:663: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 1 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj75 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:14:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:14:56.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj75 2026-02-18T00:14:56.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:14:56.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj75 2026-02-18T00:14:56.686 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-18T00:14:56.686 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:14:56.911 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:2147483647' 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:14:56.912 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-18T00:14:56.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:14:56.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T00:14:56.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:14:56.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:14:56.915 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:14:56.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:14:56.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:14:56.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:56.965 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:14:56.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:14:56.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.1.asok injectdataerr pool-jerasure obj75 1 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:665: TEST_ec_recovery_unfound: activate_osd td/test-erasure-eio 2 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:14:57.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:14:57.018 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:14:57.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:14:57.020 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:14:57.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:14:57.032 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:57.030+0000 7f427d20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:57.033 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:57.032+0000 7f427d20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:57.034 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:57.033+0000 7f427d20d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:14:57.163 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:57.161+0000 7f427d20d900 -1 Falling back to public interface 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:57.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:14:57.245 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:14:57.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:57.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:57.470 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:14:57.471 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:14:57.469+0000 7f427d20d900 -1 osd.2 41 log_to_monitors true 2026-02-18T00:14:58.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:14:58.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:14:58.472 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:14:58.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:14:58.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:14:58.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:14:58.699 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up out weight 0 up_from 47 up_thru 19 down_at 42 last_clean_interval [19,41) [v2:127.0.0.1:6818/1744415043,v1:127.0.0.1:6819/1744415043] [v2:127.0.0.1:6820/1744415043,v1:127.0.0.1:6821/1744415043] exists,up aa3ee528-de14-42ee-bf06-d2e09805ca5c 2026-02-18T00:14:58.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:14:58.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:14:58.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:14:58.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:666: TEST_ec_recovery_unfound: ceph osd in 2 2026-02-18T00:14:58.979 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already in. 2026-02-18T00:14:58.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:668: TEST_ec_recovery_unfound: sleep 15 2026-02-18T00:15:13.990 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:670: TEST_ec_recovery_unfound: seq 1 100 2026-02-18T00:15:13.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:670: TEST_ec_recovery_unfound: for tmp in $(seq 1 100) 2026-02-18T00:15:13.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:671: TEST_ec_recovery_unfound: get_state 2.0 2026-02-18T00:15:13.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-18T00:15:13.992 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-18T00:15:13.992 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-18T00:15:13.992 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-18T00:15:14.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:671: TEST_ec_recovery_unfound: state=active+recovery_unfound+degraded 2026-02-18T00:15:14.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:672: TEST_ec_recovery_unfound: echo active+recovery_unfound+degraded 2026-02-18T00:15:14.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:672: TEST_ec_recovery_unfound: grep recovery_unfound 2026-02-18T00:15:14.218 INFO:tasks.workunit.client.0.trial061.stdout:active+recovery_unfound+degraded 2026-02-18T00:15:14.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:673: TEST_ec_recovery_unfound: '[' 0 = 0 ']' 2026-02-18T00:15:14.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:674: TEST_ec_recovery_unfound: break 2026-02-18T00:15:14.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-18T00:15:14.430 INFO:tasks.workunit.client.0.trial061.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:2.0 101 1 3 0 1 413696 0 0 101 0 101 active+recovery_unfound+degraded 2026-02-18T00:14:59.016233+0000 45'101 52:360 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-18T00:14:48.062470+0000 0'0 2026-02-18T00:14:48.062470+0000 0 0 no scrub is scheduled 0 0 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:59.013439+0000 0'0 52:61 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T03:17:40.432739+0000 0 0 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.354679+0000 0'0 52:117 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T08:06:08.986762+0000 0 0 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:47.499630+0000 0'0 52:43 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T10:04:14.552336+0000 0 0 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-18T00:14:59.013567+0000 0'0 52:100 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-18T00:14:33.763358+0000 0'0 2026-02-18T00:14:33.763358+0000 0 0 periodic scrub scheduled @ 2026-02-19T07:51:31.062878+0000 0 0 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout: 2026-02-18T00:15:14.431 INFO:tasks.workunit.client.0.trial061.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-18T00:15:14.432 INFO:tasks.workunit.client.0.trial061.stderr:dumped pgs 2026-02-18T00:15:14.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:681: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:15:14.501 INFO:tasks.workunit.client.0.trial061.stdout:{ 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "num_missing": 1, 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "num_unfound": 1, 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "objects": [ 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "oid": { 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "oid": "obj75", 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "key": "", 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "snapid": -2, 2026-02-18T00:15:14.502 INFO:tasks.workunit.client.0.trial061.stdout: "hash": 3565005477, 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "max": 0, 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "pool": 2, 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "namespace": "" 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "need": "45'76", 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "have": "0'0", 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "flags": "none", 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "locations": [ 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.503 INFO:tasks.workunit.client.0.trial061.stdout: ] 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: "state": "NotRecovering", 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: "available_might_have_unfound": true, 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: "might_have_unfound": [], 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout: "more": false 2026-02-18T00:15:14.504 INFO:tasks.workunit.client.0.trial061.stdout:} 2026-02-18T00:15:14.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: ceph pg 2.0 query 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout:{ 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "snap_trimq": "[]", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "snap_trimq_len": 0, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+recovery_unfound+degraded", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "epoch": 52, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "acting_recovery_backfill": [ 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "2(4)", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.569 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "info": { 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s0", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "0", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'101", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'75", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "0'0", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 101, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "51", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 51, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 51, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 51, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'101", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 361, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 52, 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+recovery_unfound+degraded", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:14:53.237340+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:14:59.013327+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:14:59.013327+0000", 2026-02-18T00:15:14.570 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:14:59.011829+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:14:59.016233+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 51, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "0'0", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "0'0", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 413696, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 101, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 505, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 1, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 1, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 3, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 1, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 101, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:15:14.571 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 101, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 404, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.572 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),2(4),3(0),4(2)", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 100 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),4(2)", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 1 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "peer_info": [ 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "0(3)", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s3", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "3", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'101", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'101", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "0'0", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 101, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 51, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:15:14.573 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 51, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 51, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'101", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 349, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 51, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:14:53.237340+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:14:53.651225+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:14:53.651166+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 51, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 0, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:15:14.574 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:40:07.273732+0000", 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 413696, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 101, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 505, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 101, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 101, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 101, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 404, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:15:14.575 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 101 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.576 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "1(1)", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s1", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "1", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'101", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'101", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "0'0", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 101, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 51, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 51, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 51, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'101", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 131, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 45, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:14:53.237340+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:14:53.651225+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:14:53.651166+0000", 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 51, 2026-02-18T00:15:14.577 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "0'0", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "0'0", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:40:07.273732+0000", 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 413696, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 505, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 1, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 101, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 404, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:15:14.578 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:15:14.579 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 101 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "2(4)", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s4", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "4", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'101", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'75", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "0'0", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 101, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 51, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 51, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 51, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.580 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'101", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 137, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 49, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "state": "remapped+peering", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:14:57.834802+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:14:57.733228+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:14:57.733228+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:14:57.629534+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:14:53.237340+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:14:57.834802+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:14:57.834802+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:14:57.834802+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 51, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "0'0", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "0'0", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:15:14.581 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 413696, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 101, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 505, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 1, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 101, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 101, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 404, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.582 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "peer": "4(2)", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "pgid": "2.0s2", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "shard": "2", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_update": "45'101", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_complete": "45'101", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "log_tail": "0'0", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_user_version": 101, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill": "MAX", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete": [], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [], 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "history": { 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_created": 39, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "epoch_pool_created": 39, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_started": 51, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_interval_clean": 39, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_split": 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_marked_full": 0, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "same_up_since": 51, 2026-02-18T00:15:14.583 INFO:tasks.workunit.client.0.trial061.stdout: "same_interval_since": 51, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "same_primary_since": 39, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "prior_readable_until_ub": 0 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "stats": { 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "version": "45'101", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "reported_seq": 131, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "reported_epoch": 45, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "state": "active+undersized+degraded", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_fresh": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_change": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_active": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_peered": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean": "2026-02-18T00:14:53.237340+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_active": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_became_peered": "2026-02-18T00:14:53.652237+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_unstale": "2026-02-18T00:14:56.349514+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_undegraded": "2026-02-18T00:14:53.651225+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_fullsized": "2026-02-18T00:14:53.651166+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "mapping_epoch": 51, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "log_start": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_start": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "created": 39, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_clean": 40, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "parent": "0.0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "parent_split_bits": 0, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub": "0'0", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_deep_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "last_clean_scrub_stamp": "2026-02-18T00:14:48.062470+0000", 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "objects_scrubbed": 0, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "log_size": 101, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "log_dups_size": 0, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "ondisk_log_size": 101, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "stats_invalid": false, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "dirty_stats_invalid": false, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "omap_stats_invalid": false, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_stats_invalid": false, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "hitset_bytes_stats_invalid": false, 2026-02-18T00:15:14.584 INFO:tasks.workunit.client.0.trial061.stdout: "pin_stats_invalid": false, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "manifest_stats_invalid": false, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrimq_len": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "last_scrub_duration": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-19T01:40:07.273732+0000", 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_duration": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "objects_trimmed": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "snaptrim_duration": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "stat_sum": { 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes": 413696, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects": 101, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_clones": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_object_copies": 505, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing_on_primary": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_missing": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_degraded": 101, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_misplaced": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_unfound": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_dirty": 101, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_whiteouts": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_read": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_read_kb": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_write": 101, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_write_kb": 404, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_scrub_errors": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_shallow_scrub_errors": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_deep_scrub_errors": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_recovered": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_recovered": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_keys_recovered": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_omap": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_hit_set_archive": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_bytes_hit_set_archive": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_kb": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_kb": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_promote": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_high": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_flush_mode_low": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_some": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_evict_mode_full": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_pinned": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_legacy_snapsets": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_large_omap_objects": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_manifest": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_bytes": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_omap_keys": 0, 2026-02-18T00:15:14.585 INFO:tasks.workunit.client.0.trial061.stdout: "num_objects_repaired": 0 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "up": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "acting": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 3, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 1, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 4, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 0, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: 2 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "avail_no_missing": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "3(0)", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "0(3)", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "1(1)", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "4(2)" 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "object_location_counts": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "objects": 101 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "blocked_by": [], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "up_primary": 3, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "acting_primary": 3, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "purged_snaps": [] 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "empty": 0, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "dne": 0, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "incomplete": 0, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "last_epoch_started": 52, 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "hit_set_history": { 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "current_last_update": "0'0", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "history": [] 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_state": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "name": "Started/Primary/Active", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "enter_time": "2026-02-18T00:14:59.011639+0000", 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: "might_have_unfound": [ 2026-02-18T00:15:14.586 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "0(3)", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "1(1)", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "2(4)", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "osd": "4(2)", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "status": "already probed" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_progress": { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "backfill_targets": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "waiting_on_backfill": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "last_backfill_started": "MIN", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "backfill_info": { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "begin": "MIN", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "end": "MIN", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "objects": [] 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "peer_backfill_info": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "backfills_in_flight": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "recovering": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "pg_backend": { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "recovery_ops": [], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "read_ops": [] 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "name": "Started", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "enter_time": "2026-02-18T00:14:58.911800+0000" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: } 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: ], 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "scrubber": { 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "active": false, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "must_scrub": false, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "must_deep_scrub": false, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "must_repair": false, 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "scrub_reg_stamp": "2026-02-19T01:40:07.273732+0000", 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: "schedule": "not registered for scrubbing" 2026-02-18T00:15:14.587 INFO:tasks.workunit.client.0.trial061.stdout: }, 2026-02-18T00:15:14.588 INFO:tasks.workunit.client.0.trial061.stdout: "agent_state": {} 2026-02-18T00:15:14.588 INFO:tasks.workunit.client.0.trial061.stdout:} 2026-02-18T00:15:14.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:684: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:15:14.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:684: TEST_ec_recovery_unfound: grep -q obj75 2026-02-18T00:15:14.642 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:15:14.643 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: jq .available_might_have_unfound 2026-02-18T00:15:14.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: check=true 2026-02-18T00:15:14.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: test true == true 2026-02-18T00:15:14.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-18T00:15:14.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: jq '.might_have_unfound | length' 2026-02-18T00:15:14.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: check=0 2026-02-18T00:15:14.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:690: TEST_ec_recovery_unfound: test 0 == 0 2026-02-18T00:15:14.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:693: TEST_ec_recovery_unfound: timeout 5 rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-18T00:15:19.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:694: TEST_ec_recovery_unfound: test 124 = 124 2026-02-18T00:15:19.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:696: TEST_ec_recovery_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-18T00:15:19.840 INFO:tasks.workunit.client.0.trial061.stderr:pg has no unfound objects 2026-02-18T00:15:19.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:698: TEST_ec_recovery_unfound: wait_for_clean 2026-02-18T00:15:19.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:15:19.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:15:19.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:15:19.847 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:15:19.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:15:19.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:15:19.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:15:19.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:15:19.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:15:19.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:4' 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:15:20.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:20.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:15:20.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803789 2026-02-18T00:15:20.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803789 2026-02-18T00:15:20.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789' 2026-02-18T00:15:20.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:20.220 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:15:20.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574861 2026-02-18T00:15:20.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574861 2026-02-18T00:15:20.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-55834574861' 2026-02-18T00:15:20.284 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:20.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:15:20.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=201863462919 2026-02-18T00:15:20.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 201863462919 2026-02-18T00:15:20.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-55834574861 2-201863462919' 2026-02-18T00:15:20.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:20.350 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:15:20.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149708 2026-02-18T00:15:20.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149708 2026-02-18T00:15:20.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-55834574861 2-201863462919 3-111669149708' 2026-02-18T00:15:20.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:20.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:15:20.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888075 2026-02-18T00:15:20.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888075 2026-02-18T00:15:20.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-55834574861 2-201863462919 3-111669149708 4-146028888075' 2026-02-18T00:15:20.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:20.477 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803789 2026-02-18T00:15:20.477 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:20.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:15:20.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803789 2026-02-18T00:15:20.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:20.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803789 2026-02-18T00:15:20.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-18T00:15:20.480 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803789 2026-02-18T00:15:20.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:20.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803789 2026-02-18T00:15:20.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:15:21.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:15:21.705 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:21.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803789 -lt 25769803789 2026-02-18T00:15:21.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:21.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574861 2026-02-18T00:15:21.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:21.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:15:21.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574861 2026-02-18T00:15:21.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:21.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574861 2026-02-18T00:15:21.936 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574861 2026-02-18T00:15:21.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574861' 2026-02-18T00:15:21.936 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:15:22.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574861 -lt 55834574861 2026-02-18T00:15:22.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:22.159 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-201863462919 2026-02-18T00:15:22.159 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:22.160 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:15:22.160 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-201863462919 2026-02-18T00:15:22.161 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:22.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=201863462919 2026-02-18T00:15:22.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 201863462919' 2026-02-18T00:15:22.162 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 201863462919 2026-02-18T00:15:22.162 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:15:22.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 201863462919 -lt 201863462919 2026-02-18T00:15:22.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:22.387 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149708 2026-02-18T00:15:22.387 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:22.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:15:22.388 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149708 2026-02-18T00:15:22.389 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:22.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149708 2026-02-18T00:15:22.390 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149708' 2026-02-18T00:15:22.390 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149708 2026-02-18T00:15:22.390 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:15:22.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149708 -lt 111669149708 2026-02-18T00:15:22.617 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:22.618 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888075 2026-02-18T00:15:22.618 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:22.619 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:15:22.620 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888075 2026-02-18T00:15:22.620 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:22.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888075 2026-02-18T00:15:22.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888075' 2026-02-18T00:15:22.621 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888075 2026-02-18T00:15:22.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:15:22.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888075 -lt 146028888075 2026-02-18T00:15:22.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:15:22.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:22.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:23.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:15:23.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:15:23.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:15:23.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:15:23.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:23.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:23.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:15:23.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:15:23.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:15:23.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: seq 1 100 2026-02-18T00:15:23.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj1 = obj75 ']' 2026-02-18T00:15:23.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj2 = obj75 ']' 2026-02-18T00:15:23.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj3 = obj75 ']' 2026-02-18T00:15:23.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj4 = obj75 ']' 2026-02-18T00:15:23.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.765 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj5 = obj75 ']' 2026-02-18T00:15:23.766 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj6 = obj75 ']' 2026-02-18T00:15:23.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj7 = obj75 ']' 2026-02-18T00:15:23.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj8 = obj75 ']' 2026-02-18T00:15:23.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj9 = obj75 ']' 2026-02-18T00:15:23.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj10 = obj75 ']' 2026-02-18T00:15:23.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj11 = obj75 ']' 2026-02-18T00:15:23.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj12 = obj75 ']' 2026-02-18T00:15:23.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj13 = obj75 ']' 2026-02-18T00:15:23.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj14 = obj75 ']' 2026-02-18T00:15:23.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj15 = obj75 ']' 2026-02-18T00:15:23.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj16 = obj75 ']' 2026-02-18T00:15:23.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-18T00:15:23.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:23.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:23.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj17 = obj75 ']' 2026-02-18T00:15:23.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj18 = obj75 ']' 2026-02-18T00:15:24.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj19 = obj75 ']' 2026-02-18T00:15:24.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj20 = obj75 ']' 2026-02-18T00:15:24.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj21 = obj75 ']' 2026-02-18T00:15:24.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj22 = obj75 ']' 2026-02-18T00:15:24.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj23 = obj75 ']' 2026-02-18T00:15:24.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj24 = obj75 ']' 2026-02-18T00:15:24.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.138 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.138 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj25 = obj75 ']' 2026-02-18T00:15:24.138 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj26 = obj75 ']' 2026-02-18T00:15:24.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj27 = obj75 ']' 2026-02-18T00:15:24.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.193 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj28 = obj75 ']' 2026-02-18T00:15:24.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj29 = obj75 ']' 2026-02-18T00:15:24.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj30 = obj75 ']' 2026-02-18T00:15:24.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj31 = obj75 ']' 2026-02-18T00:15:24.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj32 = obj75 ']' 2026-02-18T00:15:24.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.287 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj33 = obj75 ']' 2026-02-18T00:15:24.288 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj34 = obj75 ']' 2026-02-18T00:15:24.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj35 = obj75 ']' 2026-02-18T00:15:24.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj36 = obj75 ']' 2026-02-18T00:15:24.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj37 = obj75 ']' 2026-02-18T00:15:24.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj38 = obj75 ']' 2026-02-18T00:15:24.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj39 = obj75 ']' 2026-02-18T00:15:24.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj40 = obj75 ']' 2026-02-18T00:15:24.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj41 = obj75 ']' 2026-02-18T00:15:24.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj42 = obj75 ']' 2026-02-18T00:15:24.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.471 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj43 = obj75 ']' 2026-02-18T00:15:24.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj44 = obj75 ']' 2026-02-18T00:15:24.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj45 = obj75 ']' 2026-02-18T00:15:24.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.529 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj46 = obj75 ']' 2026-02-18T00:15:24.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj47 = obj75 ']' 2026-02-18T00:15:24.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj48 = obj75 ']' 2026-02-18T00:15:24.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj49 = obj75 ']' 2026-02-18T00:15:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj50 = obj75 ']' 2026-02-18T00:15:24.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj51 = obj75 ']' 2026-02-18T00:15:24.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.641 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj52 = obj75 ']' 2026-02-18T00:15:24.642 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj53 = obj75 ']' 2026-02-18T00:15:24.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj54 = obj75 ']' 2026-02-18T00:15:24.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj55 = obj75 ']' 2026-02-18T00:15:24.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj56 = obj75 ']' 2026-02-18T00:15:24.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj57 = obj75 ']' 2026-02-18T00:15:24.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj58 = obj75 ']' 2026-02-18T00:15:24.756 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj59 = obj75 ']' 2026-02-18T00:15:24.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj60 = obj75 ']' 2026-02-18T00:15:24.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj61 = obj75 ']' 2026-02-18T00:15:24.810 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj62 = obj75 ']' 2026-02-18T00:15:24.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.846 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj63 = obj75 ']' 2026-02-18T00:15:24.847 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj64 = obj75 ']' 2026-02-18T00:15:24.866 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj65 = obj75 ']' 2026-02-18T00:15:24.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj66 = obj75 ']' 2026-02-18T00:15:24.904 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj67 = obj75 ']' 2026-02-18T00:15:24.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj68 = obj75 ']' 2026-02-18T00:15:24.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj69 = obj75 ']' 2026-02-18T00:15:24.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj70 = obj75 ']' 2026-02-18T00:15:24.979 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-18T00:15:24.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:24.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:24.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj71 = obj75 ']' 2026-02-18T00:15:24.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.015 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj72 = obj75 ']' 2026-02-18T00:15:25.016 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj73 = obj75 ']' 2026-02-18T00:15:25.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj74 = obj75 ']' 2026-02-18T00:15:25.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.072 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj75 = obj75 ']' 2026-02-18T00:15:25.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:704: TEST_ec_recovery_unfound: rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.089 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj75: (2) No such file or directory 2026-02-18T00:15:25.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj76 = obj75 ']' 2026-02-18T00:15:25.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj77 = obj75 ']' 2026-02-18T00:15:25.109 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj78 = obj75 ']' 2026-02-18T00:15:25.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.144 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj79 = obj75 ']' 2026-02-18T00:15:25.145 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj80 = obj75 ']' 2026-02-18T00:15:25.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj81 = obj75 ']' 2026-02-18T00:15:25.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj82 = obj75 ']' 2026-02-18T00:15:25.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.219 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj83 = obj75 ']' 2026-02-18T00:15:25.220 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj84 = obj75 ']' 2026-02-18T00:15:25.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj85 = obj75 ']' 2026-02-18T00:15:25.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.276 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj86 = obj75 ']' 2026-02-18T00:15:25.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.294 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.295 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj87 = obj75 ']' 2026-02-18T00:15:25.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj88 = obj75 ']' 2026-02-18T00:15:25.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj89 = obj75 ']' 2026-02-18T00:15:25.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj90 = obj75 ']' 2026-02-18T00:15:25.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj91 = obj75 ']' 2026-02-18T00:15:25.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj92 = obj75 ']' 2026-02-18T00:15:25.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj93 = obj75 ']' 2026-02-18T00:15:25.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj94 = obj75 ']' 2026-02-18T00:15:25.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj95 = obj75 ']' 2026-02-18T00:15:25.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj96 = obj75 ']' 2026-02-18T00:15:25.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj97 = obj75 ']' 2026-02-18T00:15:25.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.498 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj98 = obj75 ']' 2026-02-18T00:15:25.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj99 = obj75 ']' 2026-02-18T00:15:25.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.535 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-18T00:15:25.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj100 = obj75 ']' 2026-02-18T00:15:25.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-18T00:15:25.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:711: TEST_ec_recovery_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-18T00:15:25.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:713: TEST_ec_recovery_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:15:25.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:15:25.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:15:25.822 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:15:25.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:15:26.107 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:15:26.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:15:26.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:15:26.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:15:26.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:15:26.117 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:15:26.117 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:15:26.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:15:26.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:15:26.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:15:26.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:15:26.226 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:15:26.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:15:26.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:15:26.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:15:26.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:15:26.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:15:26.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:26.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:15:26.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:15:26.232 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:26.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:15:26.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:15:26.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:15:26.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:15:26.253 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.253 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:15:26.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:15:26.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:15:26.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:15:26.257 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:15:26.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:15:26.258 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:15:26.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:15:26.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:15:26.259 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:15:26.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:26.259 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:15:26.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:15:26.260 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:26.260 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:15:26.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:15:26.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:15:26.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:15:26.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.263 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:15:26.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:15:26.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:15:26.263 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:15:26.264 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:15:26.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:15:26.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:15:26.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:15:26.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:15:26.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:15:26.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:15:26.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:26.287 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:15:26.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:15:26.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:15:26.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:26.318 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.319 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.319 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:26.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:15:26.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:15:26.362 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:15:26.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:15:26.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:15:26.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:26.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:26.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:15:26.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:15:26.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:15:26.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:15:26.623 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:15:26.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:27.633 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:27.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:15:27.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:15:27.674 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:15:27.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:15:27.681 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:15:26.304+0000 7f7d4c5c9d80 0 load: jerasure load: lrc 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_single_recovery_error td/test-erasure-eio 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:410: TEST_ec_single_recovery_error: local dir=td/test-erasure-eio 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:411: TEST_ec_single_recovery_error: local objname=myobject 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:413: TEST_ec_single_recovery_error: setup_osds 7 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:15:27.682 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-18T00:15:27.683 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:27.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:27.688 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:27.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=63ad4d77-e13b-46fd-b146-73ddf92b1217 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 63ad4d77-e13b-46fd-b146-73ddf92b1217' 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 63ad4d77-e13b-46fd-b146-73ddf92b1217 2026-02-18T00:15:27.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:27.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCfBJVp8TOCKRAAaiBCrKPP0gjtIE92/Im35A== 2026-02-18T00:15:27.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCfBJVp8TOCKRAAaiBCrKPP0gjtIE92/Im35A=="}' 2026-02-18T00:15:27.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 63ad4d77-e13b-46fd-b146-73ddf92b1217 -i td/test-erasure-eio/0/new.json 2026-02-18T00:15:27.802 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:27.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:15:27.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCfBJVp8TOCKRAAaiBCrKPP0gjtIE92/Im35A== --osd-uuid 63ad4d77-e13b-46fd-b146-73ddf92b1217 2026-02-18T00:15:27.827 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:27.824+0000 7f78e8e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:27.829 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:27.826+0000 7f78e8e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:27.830 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:27.827+0000 7f78e8e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:27.830 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:27.827+0000 7f78e8e27900 -1 bdev(0x56242c972c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:27.830 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:27.827+0000 7f78e8e27900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:15:28.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:15:28.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:28.264 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:15:28.265 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:15:28.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:28.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:15:28.369 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:15:28.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:28.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:28.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:28.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:28.386 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:28.383+0000 7f71e6816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:28.387 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:28.384+0000 7f71e6816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:28.388 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:28.386+0000 7f71e6816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:28.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:28.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:28.468 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:28.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:28.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:15:28.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:28.591 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:28.588+0000 7f71e6816900 -1 Falling back to public interface 2026-02-18T00:15:28.840 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:28.837+0000 7f71e6816900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:15:29.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:29.567 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:29.568 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:29.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:29.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:29.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:15:29.791 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/755921361,v1:127.0.0.1:6803/755921361] [v2:127.0.0.1:6804/755921361,v1:127.0.0.1:6805/755921361] exists,up 63ad4d77-e13b-46fd-b146-73ddf92b1217 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:29.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:29.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:29.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:15:29.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:29.799 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b212b8f5-c39e-4b4f-93d7-43207d96e03e 2026-02-18T00:15:29.799 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b212b8f5-c39e-4b4f-93d7-43207d96e03e' 2026-02-18T00:15:29.799 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 b212b8f5-c39e-4b4f-93d7-43207d96e03e 2026-02-18T00:15:29.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:29.807 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQChBJVpLpcCMBAAqdzKTOrDnfCzvvzubVz9oQ== 2026-02-18T00:15:29.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQChBJVpLpcCMBAAqdzKTOrDnfCzvvzubVz9oQ=="}' 2026-02-18T00:15:29.808 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b212b8f5-c39e-4b4f-93d7-43207d96e03e -i td/test-erasure-eio/1/new.json 2026-02-18T00:15:30.035 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:30.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:15:30.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQChBJVpLpcCMBAAqdzKTOrDnfCzvvzubVz9oQ== --osd-uuid b212b8f5-c39e-4b4f-93d7-43207d96e03e 2026-02-18T00:15:30.062 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.059+0000 7f00f7140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.063 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.060+0000 7f00f7140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.064 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.061+0000 7f00f7140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.065 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.062+0000 7f00f7140900 -1 bdev(0x55c958342c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:30.065 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.062+0000 7f00f7140900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:15:30.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:15:30.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:30.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:15:30.382 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:15:30.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:30.704 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:15:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:15:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:30.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:30.721 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.718+0000 7f74d8f3b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.722 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.719+0000 7f74d8f3b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.723 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.720+0000 7f74d8f3b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:30.849 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:30.845+0000 7f74d8f3b900 -1 Falling back to public interface 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:30.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:30.930 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:30.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:30.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:15:31.139 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:31.136+0000 7f74d8f3b900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:15:31.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:32.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:15:32.392 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/460533026,v1:127.0.0.1:6811/460533026] [v2:127.0.0.1:6812/460533026,v1:127.0.0.1:6813/460533026] exists,up b212b8f5-c39e-4b4f-93d7-43207d96e03e 2026-02-18T00:15:32.396 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:32.396 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:32.396 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:32.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:32.398 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:32.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b323a386-7649-4a30-a055-03284900fe9e 2026-02-18T00:15:32.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b323a386-7649-4a30-a055-03284900fe9e' 2026-02-18T00:15:32.401 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 b323a386-7649-4a30-a055-03284900fe9e 2026-02-18T00:15:32.401 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:32.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCkBJVpuf8vGBAAsRcTichukD7R6QE5c9olMA== 2026-02-18T00:15:32.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCkBJVpuf8vGBAAsRcTichukD7R6QE5c9olMA=="}' 2026-02-18T00:15:32.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b323a386-7649-4a30-a055-03284900fe9e -i td/test-erasure-eio/2/new.json 2026-02-18T00:15:32.635 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:15:32.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:15:32.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCkBJVpuf8vGBAAsRcTichukD7R6QE5c9olMA== --osd-uuid b323a386-7649-4a30-a055-03284900fe9e 2026-02-18T00:15:32.662 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:32.659+0000 7f7875415900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:32.664 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:32.661+0000 7f7875415900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:32.665 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:32.662+0000 7f7875415900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:32.665 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:32.662+0000 7f7875415900 -1 bdev(0x556a8f53cc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:32.665 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:32.662+0000 7f7875415900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:15:32.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:15:32.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:32.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:15:32.992 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:15:32.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:33.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:15:33.310 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:15:33.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:33.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:33.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:33.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:33.327 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:33.324+0000 7f4322c0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:33.328 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:33.325+0000 7f4322c0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:33.329 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:33.326+0000 7f4322c0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:33.457 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:33.453+0000 7f4322c0f900 -1 Falling back to public interface 2026-02-18T00:15:33.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:15:33.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:33.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:15:33.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:33.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:33.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:33.545 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:33.545 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:33.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:33.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:15:33.766 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:33.762+0000 7f4322c0f900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:15:33.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:34.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:34.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:34.769 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:34.769 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:34.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:34.770 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:15:34.997 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1738996214,v1:127.0.0.1:6819/1738996214] [v2:127.0.0.1:6820/1738996214,v1:127.0.0.1:6821/1738996214] exists,up b323a386-7649-4a30-a055-03284900fe9e 2026-02-18T00:15:35.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:35.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:35.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:35.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:15:35.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:35.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:15:35.004 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:35.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ae91c575-5ae9-425f-b6fb-3b27c3134fbc 2026-02-18T00:15:35.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 ae91c575-5ae9-425f-b6fb-3b27c3134fbc' 2026-02-18T00:15:35.005 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 ae91c575-5ae9-425f-b6fb-3b27c3134fbc 2026-02-18T00:15:35.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:35.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCnBJVpoPeuABAAhvniTAFiMstdqmEdKp5DwQ== 2026-02-18T00:15:35.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCnBJVpoPeuABAAhvniTAFiMstdqmEdKp5DwQ=="}' 2026-02-18T00:15:35.014 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ae91c575-5ae9-425f-b6fb-3b27c3134fbc -i td/test-erasure-eio/3/new.json 2026-02-18T00:15:35.240 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:15:35.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:15:35.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnBJVpoPeuABAAhvniTAFiMstdqmEdKp5DwQ== --osd-uuid ae91c575-5ae9-425f-b6fb-3b27c3134fbc 2026-02-18T00:15:35.266 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.263+0000 7f3dcc851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:35.267 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.264+0000 7f3dcc851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:35.268 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.265+0000 7f3dcc851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:35.269 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.266+0000 7f3dcc851900 -1 bdev(0x5605b4b8ac00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:35.269 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.266+0000 7f3dcc851900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:15:35.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:15:35.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:35.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:15:35.580 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:15:35.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:35.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:15:35.892 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:15:35.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:35.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:35.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:35.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:35.909 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.906+0000 7fce68e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:35.910 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.908+0000 7fce68e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:35.911 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:35.909+0000 7fce68e27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:36.050 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:36.047+0000 7fce68e27900 -1 Falling back to public interface 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:36.116 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:36.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:36.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:15:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:36.388 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:36.386+0000 7fce68e27900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:15:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:37.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:37.344 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:37.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:37.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:37.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:15:37.575 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/179285677,v1:127.0.0.1:6827/179285677] [v2:127.0.0.1:6828/179285677,v1:127.0.0.1:6829/179285677] exists,up ae91c575-5ae9-425f-b6fb-3b27c3134fbc 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:37.577 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:37.578 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:37.578 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:37.578 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:37.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:37.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ad39749f-d536-49a5-a710-c8261ab3e8fd 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 ad39749f-d536-49a5-a710-c8261ab3e8fd' 2026-02-18T00:15:37.579 INFO:tasks.workunit.client.0.trial061.stdout:add osd4 ad39749f-d536-49a5-a710-c8261ab3e8fd 2026-02-18T00:15:37.580 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:37.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCpBJVp90gkIxAA74Hp302a8krHYvjyowYz3w== 2026-02-18T00:15:37.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCpBJVp90gkIxAA74Hp302a8krHYvjyowYz3w=="}' 2026-02-18T00:15:37.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ad39749f-d536-49a5-a710-c8261ab3e8fd -i td/test-erasure-eio/4/new.json 2026-02-18T00:15:37.819 INFO:tasks.workunit.client.0.trial061.stdout:4 2026-02-18T00:15:37.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-18T00:15:37.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCpBJVp90gkIxAA74Hp302a8krHYvjyowYz3w== --osd-uuid ad39749f-d536-49a5-a710-c8261ab3e8fd 2026-02-18T00:15:37.845 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:37.843+0000 7f3dcd74b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:37.847 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:37.844+0000 7f3dcd74b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:37.848 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:37.845+0000 7f3dcd74b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:37.848 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:37.845+0000 7f3dcd74b900 -1 bdev(0x555eeb342c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:37.848 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:37.846+0000 7f3dcd74b900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-18T00:15:38.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-18T00:15:38.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:38.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-18T00:15:38.165 INFO:tasks.workunit.client.0.trial061.stdout:adding osd4 key to auth repository 2026-02-18T00:15:38.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:38.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-18T00:15:38.479 INFO:tasks.workunit.client.0.trial061.stdout:start osd.4 2026-02-18T00:15:38.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:38.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:38.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:38.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:38.496 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:38.493+0000 7f0e5c0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:38.497 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:38.494+0000 7f0e5c0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:38.498 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:38.495+0000 7f0e5c0d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:38.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:38.626+0000 7f0e5c0d7900 -1 Falling back to public interface 2026-02-18T00:15:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-18T00:15:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-18T00:15:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:38.702 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:15:38.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:38.961 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:38.958+0000 7f0e5c0d7900 -1 osd.4 0 log_to_monitors true 2026-02-18T00:15:39.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:39.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:39.925 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:39.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:39.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:39.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-18T00:15:40.151 INFO:tasks.workunit.client.0.trial061.stdout:osd.4 up in weight 1 up_from 34 up_thru 35 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2316832781,v1:127.0.0.1:6835/2316832781] [v2:127.0.0.1:6836/2316832781,v1:127.0.0.1:6837/2316832781] exists,up ad39749f-d536-49a5-a710-c8261ab3e8fd 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:40.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:40.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-18T00:15:40.154 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:40.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=95a7950e-847b-433a-845a-3d48f03c448a 2026-02-18T00:15:40.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 95a7950e-847b-433a-845a-3d48f03c448a' 2026-02-18T00:15:40.155 INFO:tasks.workunit.client.0.trial061.stdout:add osd5 95a7950e-847b-433a-845a-3d48f03c448a 2026-02-18T00:15:40.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:40.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCsBJVpAgHlCRAAGdOHEOuNMULppahYTGYW0A== 2026-02-18T00:15:40.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCsBJVpAgHlCRAAGdOHEOuNMULppahYTGYW0A=="}' 2026-02-18T00:15:40.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 95a7950e-847b-433a-845a-3d48f03c448a -i td/test-erasure-eio/5/new.json 2026-02-18T00:15:40.395 INFO:tasks.workunit.client.0.trial061.stdout:5 2026-02-18T00:15:40.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-18T00:15:40.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCsBJVpAgHlCRAAGdOHEOuNMULppahYTGYW0A== --osd-uuid 95a7950e-847b-433a-845a-3d48f03c448a 2026-02-18T00:15:40.423 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:40.420+0000 7f40026a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:40.424 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:40.421+0000 7f40026a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:40.425 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:40.422+0000 7f40026a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:40.426 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:40.423+0000 7f40026a1900 -1 bdev(0x55f42d046c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:40.426 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:40.423+0000 7f40026a1900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-18T00:15:40.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-18T00:15:40.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:40.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-18T00:15:40.735 INFO:tasks.workunit.client.0.trial061.stdout:adding osd5 key to auth repository 2026-02-18T00:15:40.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:41.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-18T00:15:41.046 INFO:tasks.workunit.client.0.trial061.stdout:start osd.5 2026-02-18T00:15:41.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:41.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:41.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:41.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:41.062 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:41.059+0000 7f7257790900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:41.063 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:41.060+0000 7f7257790900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:41.064 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:41.061+0000 7f7257790900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:41.199 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:41.196+0000 7f7257790900 -1 Falling back to public interface 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:41.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:41.271 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:41.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:41.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:15:41.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:41.520 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:41.516+0000 7f7257790900 -1 osd.5 0 log_to_monitors true 2026-02-18T00:15:42.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:42.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:42.499 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:42.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:42.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:42.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-18T00:15:42.730 INFO:tasks.workunit.client.0.trial061.stdout:osd.5 up in weight 1 up_from 43 up_thru 44 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3374897868,v1:127.0.0.1:6843/3374897868] [v2:127.0.0.1:6844/3374897868,v1:127.0.0.1:6845/3374897868] exists,up 95a7950e-847b-433a-845a-3d48f03c448a 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:42.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:42.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:42.736 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fe4dce6a-f848-4b53-98a6-61d769909243 2026-02-18T00:15:42.737 INFO:tasks.workunit.client.0.trial061.stdout:add osd6 fe4dce6a-f848-4b53-98a6-61d769909243 2026-02-18T00:15:42.738 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 fe4dce6a-f848-4b53-98a6-61d769909243' 2026-02-18T00:15:42.738 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:42.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCuBJVpdB5YLBAAIcR+oXfnHGgVT1HEaqAP1g== 2026-02-18T00:15:42.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCuBJVpdB5YLBAAIcR+oXfnHGgVT1HEaqAP1g=="}' 2026-02-18T00:15:42.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fe4dce6a-f848-4b53-98a6-61d769909243 -i td/test-erasure-eio/6/new.json 2026-02-18T00:15:42.979 INFO:tasks.workunit.client.0.trial061.stdout:6 2026-02-18T00:15:42.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-18T00:15:42.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuBJVpdB5YLBAAIcR+oXfnHGgVT1HEaqAP1g== --osd-uuid fe4dce6a-f848-4b53-98a6-61d769909243 2026-02-18T00:15:43.006 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.003+0000 7f3deb11c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.007 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.004+0000 7f3deb11c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.008 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.005+0000 7f3deb11c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.008 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.005+0000 7f3deb11c900 -1 bdev(0x55ae8fd56c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:43.009 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.005+0000 7f3deb11c900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-18T00:15:43.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-18T00:15:43.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:43.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-18T00:15:43.338 INFO:tasks.workunit.client.0.trial061.stdout:adding osd6 key to auth repository 2026-02-18T00:15:43.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:43.649 INFO:tasks.workunit.client.0.trial061.stdout:start osd.6 2026-02-18T00:15:43.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-18T00:15:43.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:43.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:43.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:43.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:43.665 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.662+0000 7f3b3f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.667 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.664+0000 7f3b3f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.667 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.665+0000 7f3b3f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:43.793 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:43.789+0000 7f3b3f822900 -1 Falling back to public interface 2026-02-18T00:15:43.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-18T00:15:43.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:43.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-18T00:15:43.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:43.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:43.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:43.873 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:43.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:43.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:43.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:15:44.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:15:44.161 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:44.158+0000 7f3b3f822900 -1 osd.6 0 log_to_monitors true 2026-02-18T00:15:45.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:15:45.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:45.098 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:15:45.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:15:45.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:45.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-18T00:15:45.319 INFO:tasks.workunit.client.0.trial061.stdout:osd.6 up in weight 1 up_from 49 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/224223324,v1:127.0.0.1:6851/224223324] [v2:127.0.0.1:6852/224223324,v1:127.0.0.1:6853/224223324] exists,up fe4dce6a-f848-4b53-98a6-61d769909243 2026-02-18T00:15:45.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:15:45.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:15:45.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:15:45.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:15:45.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:15:45.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:15:45.367 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:15:45.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:15:45.373 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:15:28.592+0000 7f71e6816900 0 load: jerasure load: lrc 2026-02-18T00:15:45.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:415: TEST_ec_single_recovery_error: local poolname=pool-jerasure 2026-02-18T00:15:45.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:416: TEST_ec_single_recovery_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:15:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-18T00:15:45.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:15:45.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:15:46.033 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:15:46.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:15:47.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:15:47.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:15:47.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:15:47.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:15:47.044 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:15:47.045 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:15:47.045 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:15:47.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:15:47.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:15:47.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:15:47.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:15:47.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:15:47.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:15:47.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:15:47.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:15:47.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:15:47.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:15:47.352 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:15:47.352 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:15:47.352 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.353 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:15:47.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-18T00:15:47.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-18T00:15:47.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-18T00:15:47.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:15:47.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607558 2026-02-18T00:15:47.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607558 2026-02-18T00:15:47.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558' 2026-02-18T00:15:47.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:15:47.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-18T00:15:47.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-18T00:15:47.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333' 2026-02-18T00:15:47.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.544 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:15:47.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149701 2026-02-18T00:15:47.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149701 2026-02-18T00:15:47.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-111669149701' 2026-02-18T00:15:47.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.607 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:15:47.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888069 2026-02-18T00:15:47.671 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888069 2026-02-18T00:15:47.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-111669149701 4-146028888069' 2026-02-18T00:15:47.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.672 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:15:47.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593732 2026-02-18T00:15:47.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593732 2026-02-18T00:15:47.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-111669149701 4-146028888069 5-184683593732' 2026-02-18T00:15:47.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:47.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:15:47.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-18T00:15:47.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-18T00:15:47.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-111669149701 4-146028888069 5-184683593732 6-210453397507' 2026-02-18T00:15:47.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:47.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-18T00:15:47.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:47.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:15:47.800 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-18T00:15:47.800 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:47.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-18T00:15:47.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-18T00:15:47.801 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803782 2026-02-18T00:15:47.802 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:48.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-18T00:15:48.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:15:49.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:15:49.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:49.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-18T00:15:49.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:49.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607558 2026-02-18T00:15:49.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:49.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:15:49.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607558 2026-02-18T00:15:49.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:49.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607558 2026-02-18T00:15:49.252 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607558 2026-02-18T00:15:49.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-18T00:15:49.253 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:15:49.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-18T00:15:49.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:49.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411333 2026-02-18T00:15:49.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:49.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:15:49.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411333 2026-02-18T00:15:49.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:49.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411333 2026-02-18T00:15:49.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-18T00:15:49.481 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411333 2026-02-18T00:15:49.481 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:15:49.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-18T00:15:49.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:49.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149701 2026-02-18T00:15:49.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:49.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:15:49.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149701 2026-02-18T00:15:49.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:49.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149701 2026-02-18T00:15:49.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149701' 2026-02-18T00:15:49.709 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149701 2026-02-18T00:15:49.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:15:49.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149701 -lt 111669149701 2026-02-18T00:15:49.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:49.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888069 2026-02-18T00:15:49.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:49.935 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:15:49.935 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888069 2026-02-18T00:15:49.936 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:49.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888069 2026-02-18T00:15:49.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888069' 2026-02-18T00:15:49.937 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888069 2026-02-18T00:15:49.938 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:15:50.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888069 -lt 146028888069 2026-02-18T00:15:50.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:50.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-184683593732 2026-02-18T00:15:50.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:50.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:15:50.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-184683593732 2026-02-18T00:15:50.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:50.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593732 2026-02-18T00:15:50.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 184683593732' 2026-02-18T00:15:50.170 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 184683593732 2026-02-18T00:15:50.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:15:50.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593732 -lt 184683593732 2026-02-18T00:15:50.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:50.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-210453397507 2026-02-18T00:15:50.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:50.395 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-18T00:15:50.395 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-210453397507 2026-02-18T00:15:50.396 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:50.396 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397507 2026-02-18T00:15:50.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 210453397507' 2026-02-18T00:15:50.397 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.6 seq 210453397507 2026-02-18T00:15:50.397 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-18T00:15:50.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397508 -lt 210453397507 2026-02-18T00:15:50.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:15:50.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:50.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:50.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:15:50.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:15:50.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:15:51.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:15:51.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:15:51.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:51.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:51.472 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:418: TEST_ec_single_recovery_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:15:51.473 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:15:51.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:15:51.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:15:51.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:15:51.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-18T00:15:51.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:419: TEST_ec_single_recovery_error: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-18T00:15:51.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:15:51.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:15:51.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-18T00:15:51.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:15:51.495 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:15:51.495 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:15:51.495 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:15:51.721 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:15:51.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:15:51.723 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:15:51.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:51.725 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:51.726 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:15:51.726 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:15:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:15:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:15:51.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:15:51.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-18T00:15:51.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: get_osds pool-jerasure myobject 2026-02-18T00:15:51.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:15:51.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-18T00:15:51.827 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-18T00:15:51.827 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:15:52.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: initial_osds=('3' '5' '1' '0' '6') 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: local -a initial_osds 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:422: TEST_ec_single_recovery_error: local last_osd=6 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:424: TEST_ec_single_recovery_error: kill_daemons td/test-erasure-eio TERM osd.6 2026-02-18T00:15:52.058 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:15:52.059 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:15:52.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:15:52.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:15:52.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:15:52.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:15:52.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:425: TEST_ec_single_recovery_error: ceph osd down 6 2026-02-18T00:15:52.590 INFO:tasks.workunit.client.0.trial061.stderr:osd.6 is already down. 2026-02-18T00:15:52.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:426: TEST_ec_single_recovery_error: ceph osd out 6 2026-02-18T00:15:52.843 INFO:tasks.workunit.client.0.trial061.stderr:osd.6 is already out. 2026-02-18T00:15:52.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:429: TEST_ec_single_recovery_error: wait_for_clean 2026-02-18T00:15:52.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:15:52.851 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:15:52.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:15:52.852 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:15:52.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:15:52.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:15:52.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:15:52.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:15:52.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:15:52.938 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:15:53.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:15:53.165 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:15:53.165 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:3 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:4 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:5 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:6' 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.166 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:15:53.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:15:53.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:15:53.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:15:53.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:15:53.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607561 2026-02-18T00:15:53.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607561 2026-02-18T00:15:53.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561' 2026-02-18T00:15:53.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.296 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:15:53.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411336 2026-02-18T00:15:53.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411336 2026-02-18T00:15:53.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336' 2026-02-18T00:15:53.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.361 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:15:53.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149704 2026-02-18T00:15:53.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149704 2026-02-18T00:15:53.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-111669149704' 2026-02-18T00:15:53.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.426 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-18T00:15:53.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888072 2026-02-18T00:15:53.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888072 2026-02-18T00:15:53.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-111669149704 4-146028888072' 2026-02-18T00:15:53.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.492 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-18T00:15:53.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593735 2026-02-18T00:15:53.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593735 2026-02-18T00:15:53.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-111669149704 4-146028888072 5-184683593735' 2026-02-18T00:15:53.555 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:15:53.555 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-18T00:15:53.600 INFO:tasks.workunit.client.0.trial061.stderr:Error ENXIO: problem getting command descriptions from osd.6 2026-02-18T00:15:53.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-18T00:15:53.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-18T00:15:53.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-18T00:15:53.602 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:53.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:15:53.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:53.602 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:15:53.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:15:53.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:53.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:15:53.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:15:53.604 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803785 2026-02-18T00:15:53.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:53.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-18T00:15:53.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:15:54.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:15:54.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:15:55.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-18T00:15:55.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:55.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607561 2026-02-18T00:15:55.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:55.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:15:55.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607561 2026-02-18T00:15:55.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:55.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607561 2026-02-18T00:15:55.055 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607561 2026-02-18T00:15:55.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607561' 2026-02-18T00:15:55.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:15:55.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607561 -lt 51539607561 2026-02-18T00:15:55.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:55.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411336 2026-02-18T00:15:55.277 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:55.279 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:15:55.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411336 2026-02-18T00:15:55.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:55.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411336 2026-02-18T00:15:55.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411336' 2026-02-18T00:15:55.280 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411336 2026-02-18T00:15:55.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:15:55.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411336 -lt 77309411336 2026-02-18T00:15:55.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:55.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149704 2026-02-18T00:15:55.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:55.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:15:55.505 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149704 2026-02-18T00:15:55.505 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:55.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149704 2026-02-18T00:15:55.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149704' 2026-02-18T00:15:55.507 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149704 2026-02-18T00:15:55.507 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:15:55.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149704 -lt 111669149704 2026-02-18T00:15:55.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:55.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888072 2026-02-18T00:15:55.732 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:55.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-18T00:15:55.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888072 2026-02-18T00:15:55.734 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:55.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888072 2026-02-18T00:15:55.735 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888072' 2026-02-18T00:15:55.735 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.4 seq 146028888072 2026-02-18T00:15:55.736 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-18T00:15:55.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888072 -lt 146028888072 2026-02-18T00:15:55.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:15:55.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-184683593735 2026-02-18T00:15:55.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:15:55.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-18T00:15:55.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-184683593735 2026-02-18T00:15:55.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:15:55.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593735 2026-02-18T00:15:55.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 184683593735' 2026-02-18T00:15:55.962 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.5 seq 184683593735 2026-02-18T00:15:55.963 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-18T00:15:56.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593735 -lt 184683593735 2026-02-18T00:15:56.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:15:56.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:56.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:56.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:15:56.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:15:56.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:15:56.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:15:56.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:15:56.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:15:56.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:431: TEST_ec_single_recovery_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-18T00:15:57.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:15:57.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:15:57.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-18T00:15:57.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:15:57.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:15:57.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:433: TEST_ec_single_recovery_error: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:15:57.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:15:57.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:15:57.326 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:15:57.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:15:57.630 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:15:57.639 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:15:57.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:15:57.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:15:57.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:15:57.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:15:57.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:15:57.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:15:57.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:15:57.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:15:57.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:57.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:15:57.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:15:57.754 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:57.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:15:57.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:15:57.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:15:57.771 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:15:57.772 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.772 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:15:57.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:15:57.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:15:57.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:15:57.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:15:57.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:15:57.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:15:57.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:15:57.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:15:57.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:15:57.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:15:57.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:15:57.778 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:15:57.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:57.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:15:57.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:15:57.779 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:15:57.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:15:57.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:15:57.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:15:57.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:15:57.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.781 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:15:57.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:15:57.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:15:57.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:15:57.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:15:57.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:15:57.784 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:15:57.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:15:57.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:15:57.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:57.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:57.808 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:57.808 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.809 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.809 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:57.809 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:15:57.834 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:15:57.837 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.838 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.839 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:57.839 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:15:57.839 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:15:57.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:15:57.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:15:57.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:15:57.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:15:57.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:15:57.882 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:15:57.882 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:57.882 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:15:57.883 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:15:57.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:15:57.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:58.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:58.028 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:15:58.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:15:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:15:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:15:58.143 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:15:58.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:15:59.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:15:59.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:15:59.193 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:15:59.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:15:59.199 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:15:57.825+0000 7f7bf6a18d80 0 load: jerasure load: lrc 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_0 td/test-erasure-eio 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:322: TEST_rados_get_bad_size_shard_0: local dir=td/test-erasure-eio 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:323: TEST_rados_get_bad_size_shard_0: setup_osds 4 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:15:59.200 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:15:59.201 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:15:59.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:15:59.206 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:15:59.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=53ed7850-0d39-433a-aefb-96384f06c6b6 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 53ed7850-0d39-433a-aefb-96384f06c6b6' 2026-02-18T00:15:59.208 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 53ed7850-0d39-433a-aefb-96384f06c6b6 2026-02-18T00:15:59.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:15:59.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC/BJVpaGjQDBAAU+oNlgk7VArIsmeqHJ4WyA== 2026-02-18T00:15:59.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC/BJVpaGjQDBAAU+oNlgk7VArIsmeqHJ4WyA=="}' 2026-02-18T00:15:59.218 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 53ed7850-0d39-433a-aefb-96384f06c6b6 -i td/test-erasure-eio/0/new.json 2026-02-18T00:15:59.323 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:59.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:15:59.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/BJVpaGjQDBAAU+oNlgk7VArIsmeqHJ4WyA== --osd-uuid 53ed7850-0d39-433a-aefb-96384f06c6b6 2026-02-18T00:15:59.349 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.346+0000 7f5ce1cd0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.351 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.348+0000 7f5ce1cd0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.352 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.349+0000 7f5ce1cd0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.353 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.349+0000 7f5ce1cd0900 -1 bdev(0x55604a6b8c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:15:59.353 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.349+0000 7f5ce1cd0900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:15:59.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:15:59.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:15:59.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:15:59.764 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:15:59.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:15:59.868 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:15:59.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:15:59.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:15:59.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:15:59.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:15:59.869 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:15:59.885 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.882+0000 7fbfe3827900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.887 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.884+0000 7fbfe3827900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.888 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:15:59.885+0000 7fbfe3827900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:15:59.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:15:59.969 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:15:59.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:15:59.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:16:00.065 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:00.105 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:00.102+0000 7fbfe3827900 -1 Falling back to public interface 2026-02-18T00:16:00.376 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:00.373+0000 7fbfe3827900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:16:01.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:01.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:01.067 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:16:01.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:01.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:01.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:16:01.292 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/725839474,v1:127.0.0.1:6803/725839474] [v2:127.0.0.1:6804/725839474,v1:127.0.0.1:6805/725839474] exists,up 53ed7850-0d39-433a-aefb-96384f06c6b6 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:16:01.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:01.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:01.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f1b7d7f6-df50-4b41-849f-b3fc1688399d' 2026-02-18T00:16:01.299 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:01.300 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:16:01.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDBBJVpV1c7EhAAFYhIWv/3vZuU3P4V3rfl7Q== 2026-02-18T00:16:01.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDBBJVpV1c7EhAAFYhIWv/3vZuU3P4V3rfl7Q=="}' 2026-02-18T00:16:01.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f1b7d7f6-df50-4b41-849f-b3fc1688399d -i td/test-erasure-eio/1/new.json 2026-02-18T00:16:01.539 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:16:01.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:16:01.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBBJVpV1c7EhAAFYhIWv/3vZuU3P4V3rfl7Q== --osd-uuid f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:01.564 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:01.561+0000 7f483fc25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:01.565 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:01.563+0000 7f483fc25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:01.566 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:01.563+0000 7f483fc25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:01.567 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:01.564+0000 7f483fc25900 -1 bdev(0x5633e5904c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:16:01.567 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:01.564+0000 7f483fc25900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:16:01.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:16:01.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:16:01.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:16:01.891 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:16:01.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:16:02.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:16:02.203 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:16:02.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:02.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:16:02.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:16:02.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:16:02.219 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:02.216+0000 7f594b764900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:02.221 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:02.218+0000 7f594b764900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:02.222 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:02.219+0000 7f594b764900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:02.349 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:02.345+0000 7f594b764900 -1 Falling back to public interface 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:02.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:02.428 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:16:02.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:02.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:02.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:02.671 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:02.668+0000 7f594b764900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:16:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:03.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:03.654 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:16:03.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:03.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:03.654 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:03.883 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2919798010,v1:127.0.0.1:6811/2919798010] [v2:127.0.0.1:6812/2919798010,v1:127.0.0.1:6813/2919798010] exists,up f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:03.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:03.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:03.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:03.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:16:03.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:03.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:16:03.889 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:16:03.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f1480ad-c319-4c91-a53e-82ccca92ae47 2026-02-18T00:16:03.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 1f1480ad-c319-4c91-a53e-82ccca92ae47' 2026-02-18T00:16:03.890 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 1f1480ad-c319-4c91-a53e-82ccca92ae47 2026-02-18T00:16:03.891 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:16:03.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDDBJVph9d/NRAAsnFrYpjy6iboawMT9nb3jw== 2026-02-18T00:16:03.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDDBJVph9d/NRAAsnFrYpjy6iboawMT9nb3jw=="}' 2026-02-18T00:16:03.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f1480ad-c319-4c91-a53e-82ccca92ae47 -i td/test-erasure-eio/2/new.json 2026-02-18T00:16:04.125 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:16:04.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:16:04.134 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDDBJVph9d/NRAAsnFrYpjy6iboawMT9nb3jw== --osd-uuid 1f1480ad-c319-4c91-a53e-82ccca92ae47 2026-02-18T00:16:04.152 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.149+0000 7f1dc0d4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.153 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.150+0000 7f1dc0d4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.154 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.151+0000 7f1dc0d4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.155 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.152+0000 7f1dc0d4b900 -1 bdev(0x5608a6480c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:16:04.155 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.152+0000 7f1dc0d4b900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:16:04.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:16:04.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:16:04.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:16:04.487 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:16:04.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:16:04.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:16:04.803 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:16:04.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:04.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:16:04.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:16:04.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:16:04.820 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.817+0000 7f168ce05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.821 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.818+0000 7f168ce05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.822 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.819+0000 7f168ce05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:04.945 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:04.942+0000 7f168ce05900 -1 Falling back to public interface 2026-02-18T00:16:05.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:16:05.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:05.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:16:05.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:05.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:05.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:05.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:05.031 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:16:05.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:05.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:16:05.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:05.265 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:05.262+0000 7f168ce05900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:16:06.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:06.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:06.254 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:16:06.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:06.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:06.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:16:06.479 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2441367593,v1:127.0.0.1:6819/2441367593] [v2:127.0.0.1:6820/2441367593,v1:127.0.0.1:6821/2441367593] exists,up 1f1480ad-c319-4c91-a53e-82ccca92ae47 2026-02-18T00:16:06.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:06.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:06.484 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:16:06.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 ac04df80-e5ed-433f-a635-158c57a29d3f' 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:06.486 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:16:06.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDGBJVpvT5eHRAAENm45tiugJA+LJ6v3fudTg== 2026-02-18T00:16:06.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDGBJVpvT5eHRAAENm45tiugJA+LJ6v3fudTg=="}' 2026-02-18T00:16:06.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac04df80-e5ed-433f-a635-158c57a29d3f -i td/test-erasure-eio/3/new.json 2026-02-18T00:16:06.725 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:16:06.733 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:16:06.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDGBJVpvT5eHRAAENm45tiugJA+LJ6v3fudTg== --osd-uuid ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:06.752 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:06.748+0000 7f84c9097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:06.753 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:06.750+0000 7f84c9097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:06.754 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:06.751+0000 7f84c9097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:06.754 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:06.751+0000 7f84c9097900 -1 bdev(0x557e4a35ac00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:16:06.754 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:06.751+0000 7f84c9097900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:16:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:16:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:16:07.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:16:07.097 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:16:07.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:16:07.408 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:16:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:16:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:16:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:16:07.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:16:07.425 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:07.422+0000 7f336d74f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:07.426 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:07.423+0000 7f336d74f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:07.427 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:07.424+0000 7f336d74f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:07.567 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:07.565+0000 7f336d74f900 -1 Falling back to public interface 2026-02-18T00:16:07.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:16:07.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:07.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:16:07.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:07.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:07.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:07.631 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:16:07.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:07.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:07.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:07.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:07.882 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:07.879+0000 7f336d74f900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:16:08.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:08.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:08.861 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:16:08.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:08.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:08.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:09.086 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2326571182,v1:127.0.0.1:6827/2326571182] [v2:127.0.0.1:6828/2326571182,v1:127.0.0.1:6829/2326571182] exists,up ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:09.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:09.088 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:09.089 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:16:09.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:16:09.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:16:09.133 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:16:09.137 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:16:09.139 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:16:00.105+0000 7fbfe3827900 0 load: jerasure load: lrc 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:325: TEST_rados_get_bad_size_shard_0: local poolname=pool-jerasure 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:326: TEST_rados_get_bad_size_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:16:09.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:16:09.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:16:09.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:16:09.815 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:16:09.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:16:10.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:10.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:10.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:10.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:10.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:10.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:10.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:10.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:10.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:11.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:11.139 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:11.140 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:11.140 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:11.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:11.140 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:11.140 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:11.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-18T00:16:11.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-18T00:16:11.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-18T00:16:11.207 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:11.207 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:11.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607557 2026-02-18T00:16:11.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607557 2026-02-18T00:16:11.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557' 2026-02-18T00:16:11.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:11.272 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:11.337 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:16:11.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:16:11.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-77309411331' 2026-02-18T00:16:11.338 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:11.338 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:11.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149699 2026-02-18T00:16:11.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149699 2026-02-18T00:16:11.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-77309411331 3-111669149699' 2026-02-18T00:16:11.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:11.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-18T00:16:11.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:11.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:11.405 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-18T00:16:11.405 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:11.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-18T00:16:11.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-18T00:16:11.406 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803781 2026-02-18T00:16:11.406 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:11.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803779 -lt 25769803781 2026-02-18T00:16:11.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:12.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:12.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:12.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803781 2026-02-18T00:16:12.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:12.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607557 2026-02-18T00:16:12.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:12.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:12.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607557 2026-02-18T00:16:12.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:12.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607557 2026-02-18T00:16:12.857 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607557 2026-02-18T00:16:12.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607557' 2026-02-18T00:16:12.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:13.081 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607557 -lt 51539607557 2026-02-18T00:16:13.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:13.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-18T00:16:13.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:13.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:13.083 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-18T00:16:13.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:13.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:16:13.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-18T00:16:13.085 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411331 2026-02-18T00:16:13.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:13.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-18T00:16:13.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:13.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149699 2026-02-18T00:16:13.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:13.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:13.323 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149699 2026-02-18T00:16:13.323 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:13.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149699 2026-02-18T00:16:13.324 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149699' 2026-02-18T00:16:13.325 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 111669149699 2026-02-18T00:16:13.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:13.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149699 -lt 111669149699 2026-02-18T00:16:13.551 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:13.552 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:13.552 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:13.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:13.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:13.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:13.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:13.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:13.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:13.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:14.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:14.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:14.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:14.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:14.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:14.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:14.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:328: TEST_rados_get_bad_size_shard_0: local shard_id=0 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:329: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 10 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=10 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:16:14.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-0-10 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-0-10 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:14.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:16:14.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:14.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:16:14.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-0-10 td/test-erasure-eio/ORIGINAL 2026-02-18T00:16:14.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-0-10 td/test-erasure-eio 0 10 set 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-10 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:16:14.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:14.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:14.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:14.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-10 2026-02-18T00:16:14.420 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:14.420 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:14.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-18T00:16:14.645 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:14.928 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:14.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:16:14.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-18T00:16:14.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-18T00:16:14.940 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:16:14.940 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:10 bytes copied, 3.5286e-05 s, 283 kB/s 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-18T00:16:14.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:14.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-18T00:16:15.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:15.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:15.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:15.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-18T00:16:15.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:15.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:15.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:15.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:start osd.3 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:15.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-18T00:16:15.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:16:15.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:15.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:15.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:15.422 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:15.420+0000 7f5430f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:15.423 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:15.421+0000 7f5430f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:15.424 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:15.422+0000 7f5430f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:15.555 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:15.554+0000 7f5430f88900 -1 Falling back to public interface 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:15.629 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:15.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:15.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:15.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:15.909 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:15.907+0000 7f5430f88900 -1 osd.3 35 log_to_monitors true 2026-02-18T00:16:16.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:16.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:16.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:16.857 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:16.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:16.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:17.092 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [26,35) [v2:127.0.0.1:6826/1276763824,v1:127.0.0.1:6827/1276763824] [v2:127.0.0.1:6828/1276763824,v1:127.0.0.1:6829/1276763824] exists,up ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:17.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:17.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:17.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:17.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:17.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:17.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:17.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:17.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:17.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:17.399 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:17.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:16:17.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:16:17.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:16:17.466 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:17.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:17.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607560 2026-02-18T00:16:17.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607560 2026-02-18T00:16:17.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607560' 2026-02-18T00:16:17.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:17.530 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:17.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411335 2026-02-18T00:16:17.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411335 2026-02-18T00:16:17.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607560 2-77309411335' 2026-02-18T00:16:17.596 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:17.596 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607560 2-77309411335 3-167503724547' 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:16:17.659 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:17.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:17.660 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:16:17.661 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:17.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:16:17.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:16:17.662 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803785 2026-02-18T00:16:17.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:17.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803785 2026-02-18T00:16:17.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:18.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:18.889 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:19.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-18T00:16:19.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:19.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607560 2026-02-18T00:16:19.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:19.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:19.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607560 2026-02-18T00:16:19.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:19.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607560 2026-02-18T00:16:19.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607560' 2026-02-18T00:16:19.121 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 51539607560 2026-02-18T00:16:19.121 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:19.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607560 -lt 51539607560 2026-02-18T00:16:19.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:19.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411335 2026-02-18T00:16:19.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:19.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:19.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411335 2026-02-18T00:16:19.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:19.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411335 2026-02-18T00:16:19.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411335' 2026-02-18T00:16:19.347 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411335 2026-02-18T00:16:19.348 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:19.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-18T00:16:19.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:19.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-167503724547 2026-02-18T00:16:19.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:19.582 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:19.583 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-167503724547 2026-02-18T00:16:19.583 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:19.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=167503724547 2026-02-18T00:16:19.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 167503724547' 2026-02-18T00:16:19.584 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 167503724547 2026-02-18T00:16:19.584 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:19.812 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-18T00:16:19.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:19.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:19.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:20.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:20.133 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:20.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:20.352 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:20.352 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:20.352 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:20.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:20.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:20.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:20.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:16:20.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:16:20.975 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:16:20.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-10 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:16:20.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-0-10 td/test-erasure-eio/COPY 2026-02-18T00:16:21.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:16:21.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:16:21.007 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-18T00:16:21.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-0-10 td/test-erasure-eio 1 10 set 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-10 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:16:21.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:21.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:21.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:21.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-10 2026-02-18T00:16:21.011 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-10 2026-02-18T00:16:21.011 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:21.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:21.245 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:21.245 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:21.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:21.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:21.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:21.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:16:21.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:21.559 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:21.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:16:21.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-18T00:16:21.570 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:10 bytes copied, 3.4765e-05 s, 288 kB/s 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:16:21.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:21.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:16:21.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:21.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:21.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:22.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:22.037 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:22.038 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:22.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:16:22.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:16:22.039 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:16:22.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:22.039 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:16:22.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:16:22.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:22.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:22.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:22.051 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:22.049+0000 7f0d8fcf5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:22.052 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:22.050+0000 7f0d8fcf5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:22.053 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:22.051+0000 7f0d8fcf5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:22.215 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:22.213+0000 7f0d8fcf5900 -1 Falling back to public interface 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:22.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:22.486 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:22.560 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:22.558+0000 7f0d8fcf5900 -1 osd.1 46 log_to_monitors true 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:23.487 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 47 last_clean_interval [12,46) [v2:127.0.0.1:6810/4196913467,v1:127.0.0.1:6811/4196913467] [v2:127.0.0.1:6812/4196913467,v1:127.0.0.1:6813/4196913467] exists,up f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:23.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:23.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:23.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:24.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:24.017 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:24.017 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:24.018 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:24.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:24.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:24.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:24.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803788 2026-02-18T00:16:24.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803788 2026-02-18T00:16:24.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788' 2026-02-18T00:16:24.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:24.084 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:24.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364803 2026-02-18T00:16:24.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364803 2026-02-18T00:16:24.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-214748364803' 2026-02-18T00:16:24.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:24.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:24.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411338 2026-02-18T00:16:24.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411338 2026-02-18T00:16:24.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-214748364803 2-77309411338' 2026-02-18T00:16:24.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:24.213 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:24.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724550 2026-02-18T00:16:24.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724550 2026-02-18T00:16:24.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-214748364803 2-77309411338 3-167503724550' 2026-02-18T00:16:24.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:24.278 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803788 2026-02-18T00:16:24.278 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:24.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:24.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803788 2026-02-18T00:16:24.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:24.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803788 2026-02-18T00:16:24.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803788' 2026-02-18T00:16:24.281 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803788 2026-02-18T00:16:24.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:24.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803786 -lt 25769803788 2026-02-18T00:16:24.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:25.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:25.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:25.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803786 -lt 25769803788 2026-02-18T00:16:25.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:26.734 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:16:26.735 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:26.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803788 -lt 25769803788 2026-02-18T00:16:26.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:26.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364803 2026-02-18T00:16:26.958 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:26.959 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:26.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-214748364803 2026-02-18T00:16:26.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:26.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364803 2026-02-18T00:16:26.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 214748364803' 2026-02-18T00:16:26.961 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 214748364803 2026-02-18T00:16:26.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:27.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364803 -lt 214748364803 2026-02-18T00:16:27.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:27.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411338 2026-02-18T00:16:27.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:27.189 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:27.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411338 2026-02-18T00:16:27.189 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:27.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411338 2026-02-18T00:16:27.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411338' 2026-02-18T00:16:27.191 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411338 2026-02-18T00:16:27.191 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:27.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411338 -lt 77309411338 2026-02-18T00:16:27.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:27.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-167503724550 2026-02-18T00:16:27.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:27.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:27.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-167503724550 2026-02-18T00:16:27.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:27.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=167503724550 2026-02-18T00:16:27.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 167503724550' 2026-02-18T00:16:27.416 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 167503724550 2026-02-18T00:16:27.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:27.640 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 167503724551 -lt 167503724550 2026-02-18T00:16:27.640 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:27.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:27.641 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:27.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:27.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:27.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:27.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:27.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:27.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:27.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:27.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:28.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:28.175 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:28.175 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:28.175 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:28.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:28.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:28.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:28.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:16:28.492 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:16:28.808 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-10 fail 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-10 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-18T00:16:28.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72662-0-10 td/test-erasure-eio/COPY 2026-02-18T00:16:28.838 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj-size-72662-0-10: (5) Input/output error 2026-02-18T00:16:28.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-18T00:16:28.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:330: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 0 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=0 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-0-0 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:16:28.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-0-0 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:16:28.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-0-0 td/test-erasure-eio/ORIGINAL 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-0-0 td/test-erasure-eio 0 0 set 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:28.861 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:29.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:29.091 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:29.091 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:29.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:29.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:29.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:29.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-18T00:16:29.092 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:29.405 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:29.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:16:29.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-18T00:16:29.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:29.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:29.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:29.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:29.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-18T00:16:29.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:29.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:29.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:16:29.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:29.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:29.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:start osd.3 2026-02-18T00:16:29.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:29.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-18T00:16:29.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:16:29.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:29.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:29.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:29.870 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:29.867+0000 7f33dfa97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:29.871 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:29.869+0000 7f33dfa97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:29.872 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:29.870+0000 7f33dfa97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:30.007 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:30.005+0000 7f33dfa97900 -1 Falling back to public interface 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:30.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:30.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:30.402 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:30.400+0000 7f33dfa97900 -1 osd.3 54 log_to_monitors true 2026-02-18T00:16:31.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:31.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:31.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:31.315 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:31.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:31.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:31.542 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 up in weight 1 up_from 59 up_thru 59 down_at 56 last_clean_interval [39,54) [v2:127.0.0.1:6826/1190015533,v1:127.0.0.1:6827/1190015533] [v2:127.0.0.1:6828/1190015533,v1:127.0.0.1:6829/1190015533] exists,up ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:31.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:31.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:31.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:31.543 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:31.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:31.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:31.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:31.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803792 2026-02-18T00:16:31.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803792 2026-02-18T00:16:31.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792' 2026-02-18T00:16:31.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:31.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:31.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364806 2026-02-18T00:16:31.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364806 2026-02-18T00:16:31.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-214748364806' 2026-02-18T00:16:31.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:31.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:32.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411342 2026-02-18T00:16:32.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411342 2026-02-18T00:16:32.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-214748364806 2-77309411342' 2026-02-18T00:16:32.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:32.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070467 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070467 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-214748364806 2-77309411342 3-253403070467' 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803792 2026-02-18T00:16:32.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:32.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:32.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803792 2026-02-18T00:16:32.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:32.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803792 2026-02-18T00:16:32.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803792' 2026-02-18T00:16:32.119 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803792 2026-02-18T00:16:32.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:32.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803792 -lt 25769803792 2026-02-18T00:16:32.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:32.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364806 2026-02-18T00:16:32.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:32.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:32.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-214748364806 2026-02-18T00:16:32.346 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:32.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364806 2026-02-18T00:16:32.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 214748364806' 2026-02-18T00:16:32.347 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 214748364806 2026-02-18T00:16:32.347 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:32.572 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364806 -lt 214748364806 2026-02-18T00:16:32.573 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:32.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411342 2026-02-18T00:16:32.573 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:32.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:32.575 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411342 2026-02-18T00:16:32.575 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:32.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411342 2026-02-18T00:16:32.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411342' 2026-02-18T00:16:32.576 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411342 2026-02-18T00:16:32.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:32.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411342 -lt 77309411342 2026-02-18T00:16:32.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:32.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-253403070467 2026-02-18T00:16:32.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:32.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:32.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-253403070467 2026-02-18T00:16:32.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:32.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=253403070467 2026-02-18T00:16:32.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 253403070467' 2026-02-18T00:16:32.806 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 253403070467 2026-02-18T00:16:32.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:33.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 253403070467 2026-02-18T00:16:33.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:34.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:34.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:34.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 253403070467 -lt 253403070467 2026-02-18T00:16:34.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:34.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:34.263 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:34.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:34.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:34.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:34.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:34.790 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:34.791 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:34.791 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:35.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:35.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:35.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:35.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:16:35.100 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:16:35.416 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:16:35.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:35.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:16:35.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:16:35.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-0 2026-02-18T00:16:35.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:16:35.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:16:35.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-0-0 td/test-erasure-eio/COPY 2026-02-18T00:16:35.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:16:35.447 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:16:35.448 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-0-0 td/test-erasure-eio 1 0 set 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-0 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:35.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-0 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-0 2026-02-18T00:16:35.452 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:16:35.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:35.989 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:36.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:16:36.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-18T00:16:36.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-18T00:16:36.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:36.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:36.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:36.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:36.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:36.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:36.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:36.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:36.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:36.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:36.449 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:16:36.450 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:16:36.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:36.451 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:16:36.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:16:36.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:36.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:36.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:36.464 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:36.462+0000 7fad8dbda900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:36.466 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:36.464+0000 7fad8dbda900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:36.466 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:36.465+0000 7fad8dbda900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:36.605 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:36.603+0000 7fad8dbda900 -1 Falling back to public interface 2026-02-18T00:16:36.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:16:36.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:36.672 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:36.673 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:36.871 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:36.869+0000 7fad8dbda900 -1 osd.1 62 log_to_monitors true 2026-02-18T00:16:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:37.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:37.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:37.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:37.903 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:37.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:37.903 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:38.126 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 68 up_thru 68 down_at 65 last_clean_interval [50,62) [v2:127.0.0.1:6810/2988611192,v1:127.0.0.1:6811/2988611192] [v2:127.0.0.1:6812/2988611192,v1:127.0.0.1:6813/2988611192] exists,up f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:38.127 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:38.128 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:38.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:38.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:38.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:38.213 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:38.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:38.443 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:38.444 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:38.444 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:38.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:38.444 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:38.444 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:38.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803795 2026-02-18T00:16:38.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803795 2026-02-18T00:16:38.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795' 2026-02-18T00:16:38.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:38.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:38.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776131 2026-02-18T00:16:38.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776131 2026-02-18T00:16:38.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-292057776131' 2026-02-18T00:16:38.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:38.575 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:38.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411345 2026-02-18T00:16:38.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411345 2026-02-18T00:16:38.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-292057776131 2-77309411345' 2026-02-18T00:16:38.637 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:38.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070470 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070470 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-292057776131 2-77309411345 3-253403070470' 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803795 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:38.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:38.704 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803795 2026-02-18T00:16:38.704 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:38.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803795 2026-02-18T00:16:38.705 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803795' 2026-02-18T00:16:38.705 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803795 2026-02-18T00:16:38.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803793 -lt 25769803795 2026-02-18T00:16:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:39.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:39.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:40.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803795 -lt 25769803795 2026-02-18T00:16:40.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:40.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776131 2026-02-18T00:16:40.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:40.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:40.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776131 2026-02-18T00:16:40.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:40.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776131 2026-02-18T00:16:40.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776131' 2026-02-18T00:16:40.159 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 292057776131 2026-02-18T00:16:40.159 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:40.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776131 -lt 292057776131 2026-02-18T00:16:40.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:40.384 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411345 2026-02-18T00:16:40.384 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:40.385 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:40.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411345 2026-02-18T00:16:40.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:40.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411345 2026-02-18T00:16:40.387 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411345' 2026-02-18T00:16:40.387 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411345 2026-02-18T00:16:40.387 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:40.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411345 -lt 77309411345 2026-02-18T00:16:40.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:40.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-253403070470 2026-02-18T00:16:40.622 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:40.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:40.623 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-253403070470 2026-02-18T00:16:40.623 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:40.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=253403070470 2026-02-18T00:16:40.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 253403070470' 2026-02-18T00:16:40.625 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 253403070470 2026-02-18T00:16:40.625 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:40.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 253403070470 -lt 253403070470 2026-02-18T00:16:40.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:40.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:40.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:41.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:41.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:41.393 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:41.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:41.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:41.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:41.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:41.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:41.713 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:16:41.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:16:42.027 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-0 fail 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-0 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-18T00:16:42.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72662-0-0 td/test-erasure-eio/COPY 2026-02-18T00:16:42.056 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj-size-72662-0-0: (5) Input/output error 2026-02-18T00:16:42.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-18T00:16:42.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:331: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 256 add 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=256 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:16:42.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=add 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-0-256 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-0-256 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:16:42.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-0-256 td/test-erasure-eio/ORIGINAL 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-0-256 td/test-erasure-eio 0 256 add 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-256 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:42.078 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:42.079 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-256 2026-02-18T00:16:42.079 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:42.079 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:42.303 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-18T00:16:42.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:42.588 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:42.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-18T00:16:42.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:42.599 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-18T00:16:42.600 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:42.600 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:42.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:42.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:42.600 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:42.905 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:42.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-18T00:16:42.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:42.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:start osd.3 2026-02-18T00:16:42.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:42.996 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-18T00:16:42.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:16:42.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:42.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:42.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:43.011 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:43.010+0000 7f5778ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:43.013 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:43.011+0000 7f5778ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:43.014 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:43.012+0000 7f5778ed9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:43.150 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:43.148+0000 7f5778ed9900 -1 Falling back to public interface 2026-02-18T00:16:43.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:43.222 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:43.446 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:43.499 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:43.497+0000 7f5778ed9900 -1 osd.3 71 log_to_monitors true 2026-02-18T00:16:44.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:44.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:44.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:44.448 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:44.448 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:44.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [59,71) [v2:127.0.0.1:6826/3853992598,v1:127.0.0.1:6827/3853992598] [v2:127.0.0.1:6828/3853992598,v1:127.0.0.1:6829/3853992598] exists,up ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:44.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:44.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:44.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:44.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:44.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:44.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:44.764 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:44.764 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:44.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:44.985 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:45.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803798 2026-02-18T00:16:45.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803798 2026-02-18T00:16:45.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798' 2026-02-18T00:16:45.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:45.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:45.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776134 2026-02-18T00:16:45.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776134 2026-02-18T00:16:45.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-292057776134' 2026-02-18T00:16:45.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:45.115 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:45.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411348 2026-02-18T00:16:45.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411348 2026-02-18T00:16:45.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-292057776134 2-77309411348' 2026-02-18T00:16:45.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:45.180 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481795 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481795 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-292057776134 2-77309411348 3-330712481795' 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803798 2026-02-18T00:16:45.245 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:45.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:45.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803798 2026-02-18T00:16:45.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:45.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803798 2026-02-18T00:16:45.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803798' 2026-02-18T00:16:45.248 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803798 2026-02-18T00:16:45.248 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:45.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803796 -lt 25769803798 2026-02-18T00:16:45.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:46.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:46.483 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:46.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803798 -lt 25769803798 2026-02-18T00:16:46.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:46.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776134 2026-02-18T00:16:46.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:46.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:46.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776134 2026-02-18T00:16:46.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:46.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776134 2026-02-18T00:16:46.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776134' 2026-02-18T00:16:46.711 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 292057776134 2026-02-18T00:16:46.712 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:46.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776134 -lt 292057776134 2026-02-18T00:16:46.939 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:46.940 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411348 2026-02-18T00:16:46.940 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:46.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:46.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411348 2026-02-18T00:16:46.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:46.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411348 2026-02-18T00:16:46.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411348' 2026-02-18T00:16:46.942 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411348 2026-02-18T00:16:46.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:47.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411348 -lt 77309411348 2026-02-18T00:16:47.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:47.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-330712481795 2026-02-18T00:16:47.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:47.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:47.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-330712481795 2026-02-18T00:16:47.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:47.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=330712481795 2026-02-18T00:16:47.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 330712481795' 2026-02-18T00:16:47.170 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 330712481795 2026-02-18T00:16:47.171 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:47.393 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 330712481795 -lt 330712481795 2026-02-18T00:16:47.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:47.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:47.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:47.706 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:47.936 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:47.937 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:47.937 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:47.937 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:48.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:48.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:48.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:48.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-18T00:16:48.254 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:16:48.254 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:256 bytes copied, 2.097e-05 s, 12.2 MB/s 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-18T00:16:48.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:48.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:48.560 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:48.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:48.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:48.701 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:48.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:start osd.3 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:48.703 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-18T00:16:48.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-18T00:16:48.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:48.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:48.704 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:48.715 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:48.713+0000 7f66ac9c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:48.716 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:48.714+0000 7f66ac9c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:48.717 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:48.715+0000 7f66ac9c8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:48.848 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:48.846+0000 7f66ac9c8900 -1 Falling back to public interface 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:48.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:48.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:49.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:49.173 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:49.170+0000 7f66ac9c8900 -1 osd.3 79 log_to_monitors true 2026-02-18T00:16:50.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:50.149 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:50.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:50.150 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:50.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:50.150 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:16:50.377 INFO:tasks.workunit.client.0.trial061.stderr:osd.3 up in weight 1 up_from 83 up_thru 83 down_at 80 last_clean_interval [77,79) [v2:127.0.0.1:6826/2228981447,v1:127.0.0.1:6827/2228981447] [v2:127.0.0.1:6828/2228981447,v1:127.0.0.1:6829/2228981447] exists,up ac04df80-e5ed-433f-a635-158c57a29d3f 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:50.378 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:50.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:50.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:50.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:50.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:50.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:50.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:50.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:50.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:50.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:50.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803801 2026-02-18T00:16:50.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803801 2026-02-18T00:16:50.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801' 2026-02-18T00:16:50.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:50.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776137 2026-02-18T00:16:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776137 2026-02-18T00:16:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-292057776137' 2026-02-18T00:16:50.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:50.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:50.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411351 2026-02-18T00:16:50.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411351 2026-02-18T00:16:50.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-292057776137 2-77309411351' 2026-02-18T00:16:50.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:50.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:50.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285571 2026-02-18T00:16:50.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285571 2026-02-18T00:16:50.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-292057776137 2-77309411351 3-356482285571' 2026-02-18T00:16:50.951 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:50.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803801 2026-02-18T00:16:50.951 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:50.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:50.953 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803801 2026-02-18T00:16:50.953 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:50.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803801 2026-02-18T00:16:50.954 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803801' 2026-02-18T00:16:50.954 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803801 2026-02-18T00:16:50.955 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:51.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803799 -lt 25769803801 2026-02-18T00:16:51.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:52.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:52.179 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:52.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803802 -lt 25769803801 2026-02-18T00:16:52.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:52.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776137 2026-02-18T00:16:52.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:52.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:52.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776137 2026-02-18T00:16:52.404 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:52.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776137 2026-02-18T00:16:52.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776137' 2026-02-18T00:16:52.406 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 292057776137 2026-02-18T00:16:52.406 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:52.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776138 -lt 292057776137 2026-02-18T00:16:52.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:52.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411351 2026-02-18T00:16:52.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:52.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:52.632 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411351 2026-02-18T00:16:52.632 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:52.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411351 2026-02-18T00:16:52.634 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411351' 2026-02-18T00:16:52.634 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411351 2026-02-18T00:16:52.634 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:52.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411352 -lt 77309411351 2026-02-18T00:16:52.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:52.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285571 2026-02-18T00:16:52.859 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:52.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:52.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285571 2026-02-18T00:16:52.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:52.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285571 2026-02-18T00:16:52.862 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285571' 2026-02-18T00:16:52.862 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 356482285571 2026-02-18T00:16:52.862 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:53.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285571 -lt 356482285571 2026-02-18T00:16:53.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:53.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:53.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:53.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:53.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:53.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:53.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:53.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:53.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:53.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:53.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:16:53.636 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:16:53.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:16:53.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:53.637 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:53.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:16:53.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:16:53.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:16:53.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:16:53.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:16:54.288 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-256 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:16:54.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-0-256 td/test-erasure-eio/COPY 2026-02-18T00:16:54.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:16:54.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:16:54.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-0-256 td/test-erasure-eio 1 256 add 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-0-256 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:16:54.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-0-256 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-0-256 2026-02-18T00:16:54.321 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:16:54.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:16:54.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:16:54.862 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:16:54.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-18T00:16:54.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:54.873 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:16:54.874 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:16:54.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:16:54.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:16:54.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:16:55.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:55.181 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:16:55.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:16:55.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:16:55.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:16:55.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:16:55.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:16:55.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:16:55.269 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:16:55.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:16:55.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:16:55.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:16:55.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:16:55.282 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:55.279+0000 7f6a54dbf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:55.283 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:55.280+0000 7f6a54dbf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:55.284 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:55.281+0000 7f6a54dbf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:16:55.403 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:55.400+0000 7f6a54dbf900 -1 Falling back to public interface 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:55.490 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:55.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:16:55.780 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:16:55.777+0000 7f6a54dbf900 -1 osd.1 88 log_to_monitors true 2026-02-18T00:16:56.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:16:56.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:16:56.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:16:56.727 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:56.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:16:56.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:16:56.952 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 92 up_thru 92 down_at 89 last_clean_interval [68,88) [v2:127.0.0.1:6810/3175123443,v1:127.0.0.1:6811/3175123443] [v2:127.0.0.1:6812/3175123443,v1:127.0.0.1:6813/3175123443] exists,up f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:16:56.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:16:56.953 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:16:56.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:16:56.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:16:56.954 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:16:57.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:16:57.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:16:57.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:16:57.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:16:57.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:16:57.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:16:57.266 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:57.267 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:16:57.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803805 2026-02-18T00:16:57.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803805 2026-02-18T00:16:57.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803805' 2026-02-18T00:16:57.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:57.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:16:57.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=395136991235 2026-02-18T00:16:57.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 395136991235 2026-02-18T00:16:57.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803805 1-395136991235' 2026-02-18T00:16:57.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:57.394 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:16:57.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411355 2026-02-18T00:16:57.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411355 2026-02-18T00:16:57.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803805 1-395136991235 2-77309411355' 2026-02-18T00:16:57.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:16:57.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:16:57.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285574 2026-02-18T00:16:57.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285574 2026-02-18T00:16:57.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803805 1-395136991235 2-77309411355 3-356482285574' 2026-02-18T00:16:57.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:57.525 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803805 2026-02-18T00:16:57.525 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:57.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:16:57.527 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803805 2026-02-18T00:16:57.527 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:57.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803805 2026-02-18T00:16:57.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803805' 2026-02-18T00:16:57.528 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803805 2026-02-18T00:16:57.529 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:57.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803802 -lt 25769803805 2026-02-18T00:16:57.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:16:58.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:16:58.756 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:16:58.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803805 -lt 25769803805 2026-02-18T00:16:58.982 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:58.983 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-395136991235 2026-02-18T00:16:58.983 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:58.983 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:16:58.984 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-395136991235 2026-02-18T00:16:58.984 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:58.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=395136991235 2026-02-18T00:16:58.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 395136991235' 2026-02-18T00:16:58.985 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 395136991235 2026-02-18T00:16:58.986 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:16:59.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 395136991235 -lt 395136991235 2026-02-18T00:16:59.209 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:59.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411355 2026-02-18T00:16:59.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:59.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:16:59.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411355 2026-02-18T00:16:59.211 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:59.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411355 2026-02-18T00:16:59.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411355' 2026-02-18T00:16:59.212 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411355 2026-02-18T00:16:59.213 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:16:59.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411355 -lt 77309411355 2026-02-18T00:16:59.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:16:59.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285574 2026-02-18T00:16:59.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:16:59.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:16:59.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285574 2026-02-18T00:16:59.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:16:59.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285574 2026-02-18T00:16:59.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285574' 2026-02-18T00:16:59.437 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 356482285574 2026-02-18T00:16:59.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:16:59.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285574 -lt 356482285574 2026-02-18T00:16:59.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:16:59.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:16:59.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:16:59.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:00.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:00.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:00.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:00.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:00.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:00.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:00.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:00.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-18T00:17:00.509 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:17:00.509 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:17:00.509 INFO:tasks.workunit.client.0.trial061.stderr:256 bytes copied, 2.3163e-05 s, 11.1 MB/s 2026-02-18T00:17:00.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:00.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:00.616 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:00.758 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:00.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:00.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:17:00.761 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:17:00.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:00.762 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:17:00.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:17:00.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:00.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:00.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:00.774 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:00.771+0000 7f11ea40d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:00.775 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:00.772+0000 7f11ea40d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:00.776 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:00.773+0000 7f11ea40d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:00.948 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:00.944+0000 7f11ea40d900 -1 Falling back to public interface 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:00.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:00.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:00.990 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:00.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:00.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:01.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:01.270 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:01.267+0000 7f11ea40d900 -1 osd.1 93 log_to_monitors true 2026-02-18T00:17:02.212 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:02.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:02.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:02.213 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:02.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:02.213 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:02.439 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 97 up_thru 97 down_at 94 last_clean_interval [92,93) [v2:127.0.0.1:6810/1738378102,v1:127.0.0.1:6811/1738378102] [v2:127.0.0.1:6812/1738378102,v1:127.0.0.1:6813/1738378102] exists,up f1b7d7f6-df50-4b41-849f-b3fc1688399d 2026-02-18T00:17:02.439 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:02.440 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:02.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:02.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:02.441 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:02.524 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:02.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:02.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:02.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:02.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:02.525 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:02.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:02.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:02.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803808 2026-02-18T00:17:02.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803808 2026-02-18T00:17:02.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803808' 2026-02-18T00:17:02.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:02.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:02.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827715 2026-02-18T00:17:02.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827715 2026-02-18T00:17:02.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803808 1-416611827715' 2026-02-18T00:17:02.878 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:02.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:02.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411358 2026-02-18T00:17:02.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411358 2026-02-18T00:17:02.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803808 1-416611827715 2-77309411358' 2026-02-18T00:17:02.942 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:02.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:03.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285577 2026-02-18T00:17:03.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285577 2026-02-18T00:17:03.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803808 1-416611827715 2-77309411358 3-356482285577' 2026-02-18T00:17:03.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:03.007 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803808 2026-02-18T00:17:03.008 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:03.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803808 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803808 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803808' 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803808 2026-02-18T00:17:03.010 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:03.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803806 -lt 25769803808 2026-02-18T00:17:03.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:04.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:04.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:04.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803808 -lt 25769803808 2026-02-18T00:17:04.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:04.459 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-416611827715 2026-02-18T00:17:04.460 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:04.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:04.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-416611827715 2026-02-18T00:17:04.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:04.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=416611827715 2026-02-18T00:17:04.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 416611827715' 2026-02-18T00:17:04.462 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 416611827715 2026-02-18T00:17:04.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:04.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 416611827715 -lt 416611827715 2026-02-18T00:17:04.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:04.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411358 2026-02-18T00:17:04.686 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:04.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:04.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411358 2026-02-18T00:17:04.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:04.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411358 2026-02-18T00:17:04.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411358' 2026-02-18T00:17:04.689 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411358 2026-02-18T00:17:04.689 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:04.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411358 -lt 77309411358 2026-02-18T00:17:04.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:04.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285577 2026-02-18T00:17:04.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:04.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:04.916 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285577 2026-02-18T00:17:04.916 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:04.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285577 2026-02-18T00:17:04.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285577' 2026-02-18T00:17:04.917 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 356482285577 2026-02-18T00:17:04.917 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:05.146 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285577 -lt 356482285577 2026-02-18T00:17:05.146 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:05.146 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:05.146 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:05.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:05.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:05.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:05.677 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:05.678 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:05.678 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:05.678 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:05.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:05.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:05.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:05.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:17:05.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:17:06.330 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-0-256 fail 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-0-256 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-18T00:17:06.339 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-18T00:17:06.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72662-0-256 td/test-erasure-eio/COPY 2026-02-18T00:17:06.357 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj-size-72662-0-256: (5) Input/output error 2026-02-18T00:17:06.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-18T00:17:06.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:06.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:332: TEST_rados_get_bad_size_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:17:06.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:17:06.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:17:06.594 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:17:06.602 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:17:06.878 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:17:06.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:06.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:06.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:06.995 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:17:06.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:17:06.997 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:17:06.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:17:06.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:17:06.998 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:17:07.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:17:07.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:17:07.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:17:07.000 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:17:07.001 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:17:07.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:17:07.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:17:07.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:17:07.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:07.020 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:07.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:07.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:07.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:07.022 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:07.022 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:17:07.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:17:07.023 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:17:07.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:17:07.024 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:17:07.025 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:17:07.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:17:07.025 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:17:07.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:17:07.026 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:17:07.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:17:07.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:17:07.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:17:07.029 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:17:07.029 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.029 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:17:07.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:17:07.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:17:07.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:17:07.031 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:17:07.031 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.031 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:17:07.032 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:17:07.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:07.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:17:07.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:17:07.081 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:17:07.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:17:07.127 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:17:07.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:17:07.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:17:07.278 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:07.279 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:17:07.280 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:17:07.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:17:07.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:17:07.394 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:17:07.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:08.402 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:17:08.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:17:08.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:17:08.444 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:17:08.449 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:17:08.450 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:17:07.071+0000 7f7ee32d0d80 0 load: jerasure load: lrc 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_1 td/test-erasure-eio 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:336: TEST_rados_get_bad_size_shard_1: local dir=td/test-erasure-eio 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:337: TEST_rados_get_bad_size_shard_1: setup_osds 4 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:17:08.451 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:17:08.452 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:17:08.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:17:08.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:17:08.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:17:08.454 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:17:08.455 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:17:08.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=df915e0b-442d-42a1-b1f8-59cf6d1c2e1f 2026-02-18T00:17:08.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 df915e0b-442d-42a1-b1f8-59cf6d1c2e1f' 2026-02-18T00:17:08.456 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 df915e0b-442d-42a1-b1f8-59cf6d1c2e1f 2026-02-18T00:17:08.456 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:17:08.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAEBZVpvezQGxAAKPTFjp3gi6tr9OuAatACSQ== 2026-02-18T00:17:08.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAEBZVpvezQGxAAKPTFjp3gi6tr9OuAatACSQ=="}' 2026-02-18T00:17:08.469 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new df915e0b-442d-42a1-b1f8-59cf6d1c2e1f -i td/test-erasure-eio/0/new.json 2026-02-18T00:17:08.574 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:17:08.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:17:08.582 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAEBZVpvezQGxAAKPTFjp3gi6tr9OuAatACSQ== --osd-uuid df915e0b-442d-42a1-b1f8-59cf6d1c2e1f 2026-02-18T00:17:08.599 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:08.597+0000 7faf0bfaa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:08.601 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:08.598+0000 7faf0bfaa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:08.602 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:08.599+0000 7faf0bfaa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:08.602 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:08.600+0000 7faf0bfaa900 -1 bdev(0x56267d07cc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:17:08.602 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:08.600+0000 7faf0bfaa900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:17:08.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:17:08.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:17:08.992 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:17:08.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:17:08.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:17:09.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:17:09.096 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:17:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:17:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:17:09.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:17:09.114 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:09.111+0000 7f694a3aa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:09.115 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:09.112+0000 7f694a3aa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:09.116 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:09.113+0000 7f694a3aa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:09.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:09.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:09.198 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:17:09.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:09.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:17:09.295 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:09.332 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:09.329+0000 7f694a3aa900 -1 Falling back to public interface 2026-02-18T00:17:09.592 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:09.589+0000 7f694a3aa900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:17:10.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:10.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:10.297 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:17:10.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:10.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:10.298 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:17:10.525 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/178480363,v1:127.0.0.1:6803/178480363] [v2:127.0.0.1:6804/178480363,v1:127.0.0.1:6805/178480363] exists,up df915e0b-442d-42a1-b1f8-59cf6d1c2e1f 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:17:10.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:10.531 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:10.532 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 05a6ab56-044f-4c11-8db9-7c1bea029284' 2026-02-18T00:17:10.533 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:10.534 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:17:10.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGBZVp86QqIBAApUp9zYEQH10KwDdpRPWNIA== 2026-02-18T00:17:10.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGBZVp86QqIBAApUp9zYEQH10KwDdpRPWNIA=="}' 2026-02-18T00:17:10.542 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 05a6ab56-044f-4c11-8db9-7c1bea029284 -i td/test-erasure-eio/1/new.json 2026-02-18T00:17:10.773 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:17:10.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:17:10.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGBZVp86QqIBAApUp9zYEQH10KwDdpRPWNIA== --osd-uuid 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:10.800 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:10.797+0000 7f45f8d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:10.801 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:10.799+0000 7f45f8d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:10.802 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:10.800+0000 7f45f8d2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:10.803 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:10.800+0000 7f45f8d2d900 -1 bdev(0x5654d8f40c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:17:10.803 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:10.800+0000 7f45f8d2d900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:17:11.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:17:11.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:17:11.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:17:11.117 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:17:11.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:17:11.436 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:17:11.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:17:11.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:11.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:17:11.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:17:11.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:17:11.453 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:11.450+0000 7fa10840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:11.455 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:11.452+0000 7fa10840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:11.456 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:11.453+0000 7fa10840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:11.575 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:11.572+0000 7fa10840d900 -1 Falling back to public interface 2026-02-18T00:17:11.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:17:11.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:11.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:11.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:11.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:11.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:11.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:11.662 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:17:11.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:11.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:11.885 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:11.882+0000 7fa10840d900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:17:11.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:12.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:12.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:12.891 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:17:12.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:12.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:12.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:13.117 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1566139866,v1:127.0.0.1:6811/1566139866] [v2:127.0.0.1:6812/1566139866,v1:127.0.0.1:6813/1566139866] exists,up 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:13.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:13.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:13.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:13.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:13.123 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:17:13.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:17:13.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:17:13.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:13.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef' 2026-02-18T00:17:13.125 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:13.125 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:17:13.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAJBZVpxGLOBxAA7+waOmpkmX4Xli1sErb9VA== 2026-02-18T00:17:13.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAJBZVpxGLOBxAA7+waOmpkmX4Xli1sErb9VA=="}' 2026-02-18T00:17:13.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef -i td/test-erasure-eio/2/new.json 2026-02-18T00:17:13.362 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:17:13.370 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:17:13.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAJBZVpxGLOBxAA7+waOmpkmX4Xli1sErb9VA== --osd-uuid aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:13.388 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:13.385+0000 7f29c9e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:13.390 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:13.387+0000 7f29c9e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:13.391 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:13.388+0000 7f29c9e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:13.391 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:13.388+0000 7f29c9e6b900 -1 bdev(0x561f0dd6ec00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:17:13.391 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:13.388+0000 7f29c9e6b900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:17:13.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:17:13.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:17:13.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:17:13.711 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:17:13.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:17:14.028 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:17:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:17:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:17:14.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:17:14.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:17:14.045 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:14.042+0000 7f247f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:14.046 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:14.043+0000 7f247f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:14.047 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:14.044+0000 7f247f822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:14.175 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:14.171+0000 7f247f822900 -1 Falling back to public interface 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:14.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:14.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:14.500 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:14.498+0000 7f247f822900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:17:15.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:15.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:15.482 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:17:15.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:15.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:15.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:15.701 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2160741274,v1:127.0.0.1:6819/2160741274] [v2:127.0.0.1:6820/2160741274,v1:127.0.0.1:6821/2160741274] exists,up aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:17:15.706 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:15.707 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:15.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c4936cbb-b4f5-48f8-8ef9-837fec006281 2026-02-18T00:17:15.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 c4936cbb-b4f5-48f8-8ef9-837fec006281' 2026-02-18T00:17:15.710 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 c4936cbb-b4f5-48f8-8ef9-837fec006281 2026-02-18T00:17:15.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:17:15.717 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQALBZVpDbuiKhAAVVJRdg8W0h/hHRp+N4K+1g== 2026-02-18T00:17:15.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQALBZVpDbuiKhAAVVJRdg8W0h/hHRp+N4K+1g=="}' 2026-02-18T00:17:15.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c4936cbb-b4f5-48f8-8ef9-837fec006281 -i td/test-erasure-eio/3/new.json 2026-02-18T00:17:15.944 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:17:15.952 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:17:15.953 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQALBZVpDbuiKhAAVVJRdg8W0h/hHRp+N4K+1g== --osd-uuid c4936cbb-b4f5-48f8-8ef9-837fec006281 2026-02-18T00:17:15.971 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:15.968+0000 7f1dfeea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:15.972 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:15.970+0000 7f1dfeea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:15.973 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:15.971+0000 7f1dfeea8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:15.974 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:15.971+0000 7f1dfeea8900 -1 bdev(0x560aaf634c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:17:15.974 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:15.971+0000 7f1dfeea8900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:17:16.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:17:16.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:17:16.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:17:16.302 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:17:16.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:17:16.611 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:17:16.612 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:17:16.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:16.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:17:16.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:17:16.612 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:17:16.627 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:16.625+0000 7ff8edbc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:16.629 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:16.626+0000 7ff8edbc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:16.630 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:16.627+0000 7ff8edbc7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:16.767 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:16.764+0000 7ff8edbc7900 -1 Falling back to public interface 2026-02-18T00:17:16.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:17:16.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:16.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:17:16.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:16.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:16.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:16.838 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:17:16.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:16.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:16.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:17:17.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:17.068 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:17.066+0000 7ff8edbc7900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:17:18.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:18.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:18.069 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:17:18.069 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:18.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:18.070 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:17:18.299 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1971266720,v1:127.0.0.1:6827/1971266720] [v2:127.0.0.1:6828/1971266720,v1:127.0.0.1:6829/1971266720] exists,up c4936cbb-b4f5-48f8-8ef9-837fec006281 2026-02-18T00:17:18.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:18.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:18.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:18.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:17:18.302 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:17:18.347 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:17:18.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:17:18.353 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:17:09.333+0000 7f694a3aa900 0 load: jerasure load: lrc 2026-02-18T00:17:18.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:339: TEST_rados_get_bad_size_shard_1: local poolname=pool-jerasure 2026-02-18T00:17:18.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:340: TEST_rados_get_bad_size_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:17:18.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:17:18.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:17:18.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:17:18.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:17:18.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:17:18.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:17:18.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:17:18.639 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:17:18.639 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:17:19.011 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:17:19.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:17:20.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:17:20.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:20.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:20.021 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:20.021 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:20.022 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:20.023 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:20.023 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:20.023 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:20.023 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:20.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:20.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:20.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:20.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:20.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:20.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:20.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:20.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-18T00:17:20.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-18T00:17:20.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-18T00:17:20.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:20.397 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:20.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607556 2026-02-18T00:17:20.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607556 2026-02-18T00:17:20.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607556' 2026-02-18T00:17:20.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:20.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:20.525 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444035 2026-02-18T00:17:20.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444035 2026-02-18T00:17:20.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607556 2-73014444035' 2026-02-18T00:17:20.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:20.526 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:20.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-18T00:17:20.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-18T00:17:20.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607556 2-73014444035 3-107374182403' 2026-02-18T00:17:20.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:20.590 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-18T00:17:20.590 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:20.591 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:20.591 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-18T00:17:20.592 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:20.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-18T00:17:20.593 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-18T00:17:20.593 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803781 2026-02-18T00:17:20.593 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:20.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803779 -lt 25769803781 2026-02-18T00:17:20.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:21.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:21.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:22.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803781 2026-02-18T00:17:22.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:22.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607556 2026-02-18T00:17:22.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:22.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:22.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607556 2026-02-18T00:17:22.047 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:22.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607556 2026-02-18T00:17:22.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607556' 2026-02-18T00:17:22.048 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607556 2026-02-18T00:17:22.048 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:22.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607556 -lt 51539607556 2026-02-18T00:17:22.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:22.272 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444035 2026-02-18T00:17:22.272 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:22.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:22.273 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444035 2026-02-18T00:17:22.274 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:22.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444035 2026-02-18T00:17:22.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444035' 2026-02-18T00:17:22.275 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 73014444035 2026-02-18T00:17:22.275 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:22.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444036 -lt 73014444035 2026-02-18T00:17:22.499 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:22.499 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182403 2026-02-18T00:17:22.499 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:22.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:22.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182403 2026-02-18T00:17:22.501 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:22.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182403 2026-02-18T00:17:22.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-18T00:17:22.502 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182403 2026-02-18T00:17:22.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:22.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-18T00:17:22.727 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:22.727 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:22.727 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:23.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:23.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:23.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:23.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:23.273 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:23.274 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:23.274 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:342: TEST_rados_get_bad_size_shard_1: local shard_id=1 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:343: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 10 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=10 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-1-10 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:17:23.584 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-1-10 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:17:23.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-1-10 td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-1-10 td/test-erasure-eio 1 10 set 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-10 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:17:23.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-10 2026-02-18T00:17:23.605 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:23.605 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:17:23.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:17:23.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:17:23.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:17:24.114 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:17:24.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:17:24.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-18T00:17:24.122 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-18T00:17:24.123 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:17:24.123 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:17:24.123 INFO:tasks.workunit.client.0.trial061.stderr:10 bytes copied, 3.5165e-05 s, 284 kB/s 2026-02-18T00:17:24.123 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:24.124 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:24.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:24.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:24.587 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:24.588 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:17:24.589 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:17:24.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:24.589 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:17:24.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:17:24.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:24.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:24.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:24.601 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:24.598+0000 7fd5e4bc1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:24.602 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:24.599+0000 7fd5e4bc1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:24.603 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:24.600+0000 7fd5e4bc1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:24.762 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:24.760+0000 7fd5e4bc1900 -1 Falling back to public interface 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:24.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:25.039 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:25.110 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:25.106+0000 7fd5e4bc1900 -1 osd.1 32 log_to_monitors true 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:26.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [12,32) [v2:127.0.0.1:6810/1572853221,v1:127.0.0.1:6811/1572853221] [v2:127.0.0.1:6812/1572853221,v1:127.0.0.1:6813/1572853221] exists,up 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:26.265 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:26.266 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:26.266 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:26.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:26.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:26.266 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:26.351 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:26.581 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:26.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-18T00:17:26.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-18T00:17:26.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-18T00:17:26.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:26.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:26.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-18T00:17:26.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-18T00:17:26.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-163208757251' 2026-02-18T00:17:26.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:26.710 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:26.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444039 2026-02-18T00:17:26.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444039 2026-02-18T00:17:26.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-163208757251 2-73014444039' 2026-02-18T00:17:26.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:26.776 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182406 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182406 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-163208757251 2-73014444039 3-107374182406' 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-18T00:17:26.839 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:26.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:26.840 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-18T00:17:26.840 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:26.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-18T00:17:26.842 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-18T00:17:26.842 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803785 2026-02-18T00:17:26.842 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:27.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803785 2026-02-18T00:17:27.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:28.068 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:28.069 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:28.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-18T00:17:28.296 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:28.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-163208757251 2026-02-18T00:17:28.297 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:28.297 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:28.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-163208757251 2026-02-18T00:17:28.298 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:28.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-18T00:17:28.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 163208757251' 2026-02-18T00:17:28.299 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 163208757251 2026-02-18T00:17:28.300 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:28.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-18T00:17:28.526 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:28.527 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444039 2026-02-18T00:17:28.527 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:28.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:28.528 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444039 2026-02-18T00:17:28.529 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:28.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444039 2026-02-18T00:17:28.530 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444039' 2026-02-18T00:17:28.530 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 73014444039 2026-02-18T00:17:28.530 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:28.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444039 -lt 73014444039 2026-02-18T00:17:28.760 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:28.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182406 2026-02-18T00:17:28.760 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:28.761 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:28.762 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182406 2026-02-18T00:17:28.762 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:28.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182406 2026-02-18T00:17:28.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182406' 2026-02-18T00:17:28.763 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182406 2026-02-18T00:17:28.764 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:28.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182406 -lt 107374182406 2026-02-18T00:17:28.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:28.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:28.990 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:29.292 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:29.293 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:29.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:29.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:29.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:29.513 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:29.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:29.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:29.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:29.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:17:29.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:17:30.132 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:17:30.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:30.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:17:30.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:17:30.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-10 2026-02-18T00:17:30.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:17:30.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:17:30.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-10 td/test-erasure-eio/COPY 2026-02-18T00:17:30.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:17:30.163 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:17:30.164 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-18T00:17:30.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-18T00:17:30.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-1-10 td/test-erasure-eio 2 10 set 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-10 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:30.167 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:17:30.168 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-10 2026-02-18T00:17:30.168 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:30.168 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:17:30.396 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:17:30.396 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:30.396 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:17:30.396 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:17:30.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:17:30.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:17:30.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-18T00:17:30.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:17:30.713 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:17:30.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:17:30.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-18T00:17:30.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-18T00:17:30.726 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:17:30.726 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:17:30.726 INFO:tasks.workunit.client.0.trial061.stderr:10 bytes copied, 3.5085e-05 s, 285 kB/s 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:30.727 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:30.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:30.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:30.728 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:31.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:31.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:31.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:31.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:31.033 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T00:17:31.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:31.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-18T00:17:31.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72662-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:31.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:31.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:start osd.2 2026-02-18T00:17:31.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:31.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:17:31.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:17:31.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:31.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:31.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:31.192 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:31.190+0000 7f034120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:31.194 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:31.192+0000 7f034120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:31.195 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:31.193+0000 7f034120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:31.366 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:31.364+0000 7f034120d900 -1 Falling back to public interface 2026-02-18T00:17:31.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:31.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:31.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:31.711 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:31.709+0000 7f034120d900 -1 osd.2 42 log_to_monitors true 2026-02-18T00:17:32.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:32.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:32.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:32.627 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:32.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:32.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 up in weight 1 up_from 48 up_thru 35 down_at 45 last_clean_interval [17,42) [v2:127.0.0.1:6818/3579361096,v1:127.0.0.1:6819/3579361096] [v2:127.0.0.1:6820/3579361096,v1:127.0.0.1:6821/3579361096] exists,up aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:32.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:32.860 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:32.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:32.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:32.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:32.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:32.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:32.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:33.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:33.170 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:33.170 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:33.170 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:33.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:33.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:33.171 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:33.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803788 2026-02-18T00:17:33.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803788 2026-02-18T00:17:33.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788' 2026-02-18T00:17:33.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:33.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:33.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757254 2026-02-18T00:17:33.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757254 2026-02-18T00:17:33.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-163208757254' 2026-02-18T00:17:33.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:33.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:33.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430211 2026-02-18T00:17:33.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430211 2026-02-18T00:17:33.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-163208757254 2-206158430211' 2026-02-18T00:17:33.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:33.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:33.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182410 2026-02-18T00:17:33.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182410 2026-02-18T00:17:33.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803788 1-163208757254 2-206158430211 3-107374182410' 2026-02-18T00:17:33.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:33.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803788 2026-02-18T00:17:33.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:33.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:33.433 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803788 2026-02-18T00:17:33.433 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:33.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803788 2026-02-18T00:17:33.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803788' 2026-02-18T00:17:33.435 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803788 2026-02-18T00:17:33.435 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:33.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803788 -lt 25769803788 2026-02-18T00:17:33.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:33.660 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-163208757254 2026-02-18T00:17:33.660 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:33.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:33.661 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-163208757254 2026-02-18T00:17:33.661 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:33.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757254 2026-02-18T00:17:33.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 163208757254' 2026-02-18T00:17:33.663 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 163208757254 2026-02-18T00:17:33.663 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:33.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757254 -lt 163208757254 2026-02-18T00:17:33.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:33.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430211 2026-02-18T00:17:33.892 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:33.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:33.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-206158430211 2026-02-18T00:17:33.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:33.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=206158430211 2026-02-18T00:17:33.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 206158430211' 2026-02-18T00:17:33.895 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 206158430211 2026-02-18T00:17:33.895 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:34.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 206158430211 2026-02-18T00:17:34.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:35.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:35.121 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:35.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 206158430211 2026-02-18T00:17:35.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:36.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:17:36.350 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:36.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 206158430211 -lt 206158430211 2026-02-18T00:17:36.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:36.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182410 2026-02-18T00:17:36.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:36.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:36.578 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182410 2026-02-18T00:17:36.578 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:36.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182410 2026-02-18T00:17:36.579 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182410' 2026-02-18T00:17:36.579 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182410 2026-02-18T00:17:36.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:36.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182410 -lt 107374182410 2026-02-18T00:17:36.802 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:36.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:36.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:37.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:37.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:37.113 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:37.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:37.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:37.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:37.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:37.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:37.336 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:37.337 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:37.337 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:37.337 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:37.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:37.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:37.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:37.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:17:37.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:17:37.962 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:17:37.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-18T00:17:37.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-10 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-10 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:17:37.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-10 td/test-erasure-eio/COPY 2026-02-18T00:17:37.994 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:17:37.995 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:17:37.996 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:37.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:344: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 0 2026-02-18T00:17:37.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=0 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-1-0 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:37.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-1-0 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:17:38.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-1-0 td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-1-0 td/test-erasure-eio 1 0 set 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-0 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:17:38.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-0 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:38.019 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:17:38.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:17:38.534 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:17:38.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:17:38.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-18T00:17:38.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:38.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:38.547 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:38.853 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:38.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:38.989 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:38.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:38.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:17:38.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:17:38.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:38.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:38.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:39.007 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:39.005+0000 7f1be5ba1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:39.008 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:39.006+0000 7f1be5ba1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:39.009 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:39.007+0000 7f1be5ba1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:39.185 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:39.184+0000 7f1be5ba1900 -1 Falling back to public interface 2026-02-18T00:17:39.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:17:39.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:39.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:39.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:39.224 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:39.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:39.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:39.225 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:39.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:39.225 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:39.450 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:39.529 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:39.527+0000 7f1be5ba1900 -1 osd.1 51 log_to_monitors true 2026-02-18T00:17:40.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:40.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:40.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:40.451 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:40.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:40.452 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 57 up_thru 57 down_at 54 last_clean_interval [38,51) [v2:127.0.0.1:6810/3499054028,v1:127.0.0.1:6811/3499054028] [v2:127.0.0.1:6812/3499054028,v1:127.0.0.1:6813/3499054028] exists,up 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:40.675 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:40.676 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:40.676 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:40.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:40.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:40.676 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:40.762 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:40.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:40.987 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:40.988 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:40.988 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:40.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:40.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:41.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803792 2026-02-18T00:17:41.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803792 2026-02-18T00:17:41.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792' 2026-02-18T00:17:41.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:41.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:41.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135875 2026-02-18T00:17:41.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135875 2026-02-18T00:17:41.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-244813135875' 2026-02-18T00:17:41.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:41.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:41.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430214 2026-02-18T00:17:41.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430214 2026-02-18T00:17:41.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-244813135875 2-206158430214' 2026-02-18T00:17:41.180 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:41.180 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:41.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182413 2026-02-18T00:17:41.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182413 2026-02-18T00:17:41.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803792 1-244813135875 2-206158430214 3-107374182413' 2026-02-18T00:17:41.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:41.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803792 2026-02-18T00:17:41.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:41.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:41.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803792 2026-02-18T00:17:41.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:41.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803792 2026-02-18T00:17:41.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803792' 2026-02-18T00:17:41.247 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803792 2026-02-18T00:17:41.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:41.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803792 -lt 25769803792 2026-02-18T00:17:41.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:41.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-244813135875 2026-02-18T00:17:41.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:41.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:41.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-244813135875 2026-02-18T00:17:41.480 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:41.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=244813135875 2026-02-18T00:17:41.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 244813135875' 2026-02-18T00:17:41.481 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 244813135875 2026-02-18T00:17:41.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:41.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 244813135875 -lt 244813135875 2026-02-18T00:17:41.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:41.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430214 2026-02-18T00:17:41.708 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:41.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:41.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-206158430214 2026-02-18T00:17:41.709 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:41.710 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=206158430214 2026-02-18T00:17:41.711 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 206158430214' 2026-02-18T00:17:41.711 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 206158430214 2026-02-18T00:17:41.711 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:41.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 206158430214 -lt 206158430214 2026-02-18T00:17:41.940 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:41.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182413 2026-02-18T00:17:41.941 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:41.941 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:41.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182413 2026-02-18T00:17:41.942 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:41.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182413 2026-02-18T00:17:41.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182413' 2026-02-18T00:17:41.943 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182413 2026-02-18T00:17:41.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:42.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182413 -lt 107374182413 2026-02-18T00:17:42.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:42.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:42.171 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:42.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:42.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:42.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:42.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:42.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:42.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:42.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:42.479 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:42.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:42.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:42.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:42.702 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:43.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:43.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:43.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:43.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:17:43.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:17:43.345 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:17:43.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:43.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:17:43.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:17:43.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-0 2026-02-18T00:17:43.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:17:43.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:17:43.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-0 td/test-erasure-eio/COPY 2026-02-18T00:17:43.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:17:43.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:17:43.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-1-0 td/test-erasure-eio 2 0 set 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-0 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:17:43.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-0 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:43.380 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:17:43.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-18T00:17:43.607 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:17:43.919 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:17:43.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-18T00:17:43.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-18T00:17:43.930 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:43.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:43.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:44.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:44.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:44.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:44.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:44.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T00:17:44.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:44.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-18T00:17:44.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72662-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:44.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-18T00:17:44.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:44.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:44.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:44.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:start osd.2 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:44.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:17:44.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:17:44.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:44.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:44.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:44.392 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:44.390+0000 7fe79e122900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:44.394 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:44.392+0000 7fe79e122900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:44.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:44.393+0000 7fe79e122900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:44.522 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:44.520+0000 7fe79e122900 -1 Falling back to public interface 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:44.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:44.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:44.894 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:44.892+0000 7fe79e122900 -1 osd.2 62 log_to_monitors true 2026-02-18T00:17:45.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:45.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:45.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:45.830 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:45.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:45.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:17:46.055 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 up in weight 1 up_from 66 up_thru 54 down_at 63 last_clean_interval [48,62) [v2:127.0.0.1:6818/1309273596,v1:127.0.0.1:6819/1309273596] [v2:127.0.0.1:6820/1309273596,v1:127.0.0.1:6821/1309273596] exists,up aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:46.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:46.057 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:46.057 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:46.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:46.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:46.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:46.142 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:46.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:46.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803795 2026-02-18T00:17:46.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803795 2026-02-18T00:17:46.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795' 2026-02-18T00:17:46.432 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:46.432 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:46.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135878 2026-02-18T00:17:46.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135878 2026-02-18T00:17:46.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-244813135878' 2026-02-18T00:17:46.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:46.498 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:46.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841539 2026-02-18T00:17:46.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841539 2026-02-18T00:17:46.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-244813135878 2-283467841539' 2026-02-18T00:17:46.561 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:46.562 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:46.627 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182416 2026-02-18T00:17:46.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182416 2026-02-18T00:17:46.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803795 1-244813135878 2-283467841539 3-107374182416' 2026-02-18T00:17:46.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:46.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803795 2026-02-18T00:17:46.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:46.629 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:46.629 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803795 2026-02-18T00:17:46.629 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:46.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803795 2026-02-18T00:17:46.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803795' 2026-02-18T00:17:46.630 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803795 2026-02-18T00:17:46.631 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:46.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803792 -lt 25769803795 2026-02-18T00:17:46.859 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:47.860 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:47.861 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:48.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803795 -lt 25769803795 2026-02-18T00:17:48.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:48.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-244813135878 2026-02-18T00:17:48.088 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:48.089 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:48.089 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-244813135878 2026-02-18T00:17:48.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:48.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=244813135878 2026-02-18T00:17:48.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 244813135878' 2026-02-18T00:17:48.091 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 244813135878 2026-02-18T00:17:48.091 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:48.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 244813135878 -lt 244813135878 2026-02-18T00:17:48.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:48.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841539 2026-02-18T00:17:48.316 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:48.316 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:48.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-283467841539 2026-02-18T00:17:48.317 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:48.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=283467841539 2026-02-18T00:17:48.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 283467841539' 2026-02-18T00:17:48.319 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 283467841539 2026-02-18T00:17:48.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:48.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841539 -lt 283467841539 2026-02-18T00:17:48.546 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:48.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182416 2026-02-18T00:17:48.547 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:48.548 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:48.548 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182416 2026-02-18T00:17:48.549 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:48.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182416 2026-02-18T00:17:48.550 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182416' 2026-02-18T00:17:48.550 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182416 2026-02-18T00:17:48.550 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:48.778 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182416 -lt 107374182416 2026-02-18T00:17:48.779 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:48.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:48.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:49.090 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:49.310 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:49.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:49.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:49.311 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:49.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:49.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:49.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:49.625 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:17:49.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:17:49.938 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-0 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-0 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:17:49.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-0 td/test-erasure-eio/COPY 2026-02-18T00:17:49.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:17:49.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:17:49.970 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:49.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:345: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 256 add 2026-02-18T00:17:49.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-18T00:17:49.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-18T00:17:49.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-18T00:17:49.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=256 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=add 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72662-1-256 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72662-1-256 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:17:49.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72662-1-256 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:17:49.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72662-1-256 td/test-erasure-eio/ORIGINAL 2026-02-18T00:17:49.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72662-1-256 td/test-erasure-eio 1 256 add 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-256 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:17:49.993 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-256 2026-02-18T00:17:49.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:17:49.994 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-256 2026-02-18T00:17:49.994 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-256 2026-02-18T00:17:49.994 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:17:50.220 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:17:50.220 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-18T00:17:50.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:17:50.504 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:17:50.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:50.516 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:50.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:50.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:50.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:50.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:50.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:17:50.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:50.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:50.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:50.926 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:50.924+0000 7fb920467900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:50.928 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:50.926+0000 7fb920467900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:50.929 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:50.927+0000 7fb920467900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:51.115 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:51.113+0000 7fb920467900 -1 Falling back to public interface 2026-02-18T00:17:51.138 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:51.139 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:51.367 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:51.488 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:51.486+0000 7fb920467900 -1 osd.1 71 log_to_monitors true 2026-02-18T00:17:52.368 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:52.369 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:52.369 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:52.593 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 75 up_thru 75 down_at 72 last_clean_interval [57,71) [v2:127.0.0.1:6810/942297728,v1:127.0.0.1:6811/942297728] [v2:127.0.0.1:6812/942297728,v1:127.0.0.1:6813/942297728] exists,up 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:52.594 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:52.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:52.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:52.595 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:52.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:52.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:52.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:52.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:52.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:52.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:52.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:52.910 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:52.910 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:52.911 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:52.911 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:52.911 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:52.911 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:52.973 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803798 2026-02-18T00:17:52.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803798 2026-02-18T00:17:52.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798' 2026-02-18T00:17:52.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:52.974 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:53.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547203 2026-02-18T00:17:53.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547203 2026-02-18T00:17:53.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-322122547203' 2026-02-18T00:17:53.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:53.041 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:53.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841542 2026-02-18T00:17:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841542 2026-02-18T00:17:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-322122547203 2-283467841542' 2026-02-18T00:17:53.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:53.104 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:53.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182419 2026-02-18T00:17:53.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182419 2026-02-18T00:17:53.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803798 1-322122547203 2-283467841542 3-107374182419' 2026-02-18T00:17:53.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:53.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803798 2026-02-18T00:17:53.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:53.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:53.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803798 2026-02-18T00:17:53.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:53.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803798 2026-02-18T00:17:53.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803798' 2026-02-18T00:17:53.172 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803798 2026-02-18T00:17:53.172 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:53.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803798 -lt 25769803798 2026-02-18T00:17:53.394 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:53.395 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-322122547203 2026-02-18T00:17:53.395 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:53.396 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:53.396 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-322122547203 2026-02-18T00:17:53.396 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:53.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=322122547203 2026-02-18T00:17:53.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 322122547203' 2026-02-18T00:17:53.398 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 322122547203 2026-02-18T00:17:53.398 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:53.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 322122547203 -lt 322122547203 2026-02-18T00:17:53.623 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:53.623 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841542 2026-02-18T00:17:53.624 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:53.624 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:53.625 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-283467841542 2026-02-18T00:17:53.625 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:53.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=283467841542 2026-02-18T00:17:53.626 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 283467841542' 2026-02-18T00:17:53.627 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 283467841542 2026-02-18T00:17:53.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:53.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841542 -lt 283467841542 2026-02-18T00:17:53.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:53.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182419 2026-02-18T00:17:53.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:53.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:17:53.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182419 2026-02-18T00:17:53.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:53.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182419 2026-02-18T00:17:53.856 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182419' 2026-02-18T00:17:53.856 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182419 2026-02-18T00:17:53.856 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:17:54.078 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182420 -lt 107374182419 2026-02-18T00:17:54.080 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:17:54.080 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:54.080 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:54.391 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:17:54.392 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:17:54.611 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:17:54.612 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:17:54.612 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:17:54.612 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:17:54.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:17:54.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:17:54.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:17:54.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-18T00:17:54.920 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:17:54.920 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:256 bytes copied, 2.1169e-05 s, 12.1 MB/s 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:17:54.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:17:54.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:55.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:17:55.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:17:55.176 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:17:55.177 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:17:55.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:17:55.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:17:55.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:17:55.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:17:55.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:17:55.179 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:17:55.191 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:55.189+0000 7fcaf380f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:55.192 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:55.190+0000 7fcaf380f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:55.193 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:55.191+0000 7fcaf380f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:17:55.330 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:55.328+0000 7fcaf380f900 -1 Falling back to public interface 2026-02-18T00:17:55.404 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:17:55.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:55.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:55.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:17:55.680 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:17:55.678+0000 7fcaf380f900 -1 osd.1 77 log_to_monitors true 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:17:56.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:17:56.857 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 81 up_thru 81 down_at 78 last_clean_interval [75,77) [v2:127.0.0.1:6810/3240427466,v1:127.0.0.1:6811/3240427466] [v2:127.0.0.1:6812/3240427466,v1:127.0.0.1:6813/3240427466] exists,up 05a6ab56-044f-4c11-8db9-7c1bea029284 2026-02-18T00:17:56.857 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:17:56.858 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:17:56.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:17:56.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:17:56.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:17:56.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:17:56.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:17:56.945 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:17:57.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:57.170 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:17:57.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803801 2026-02-18T00:17:57.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803801 2026-02-18T00:17:57.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801' 2026-02-18T00:17:57.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:57.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:17:57.300 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350979 2026-02-18T00:17:57.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350979 2026-02-18T00:17:57.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-347892350979' 2026-02-18T00:17:57.301 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:57.301 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:17:57.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841545 2026-02-18T00:17:57.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841545 2026-02-18T00:17:57.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-347892350979 2-283467841545' 2026-02-18T00:17:57.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:17:57.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:17:57.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182422 2026-02-18T00:17:57.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182422 2026-02-18T00:17:57.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803801 1-347892350979 2-283467841545 3-107374182422' 2026-02-18T00:17:57.428 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:57.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803801 2026-02-18T00:17:57.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:57.429 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:17:57.430 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803801 2026-02-18T00:17:57.430 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:57.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803801 2026-02-18T00:17:57.431 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803801' 2026-02-18T00:17:57.431 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803801 2026-02-18T00:17:57.431 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:17:57.652 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803801 -lt 25769803801 2026-02-18T00:17:57.652 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:57.653 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350979 2026-02-18T00:17:57.653 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:57.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:17:57.654 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350979 2026-02-18T00:17:57.654 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:57.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350979 2026-02-18T00:17:57.655 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350979' 2026-02-18T00:17:57.656 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 347892350979 2026-02-18T00:17:57.656 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:17:57.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350979 -lt 347892350979 2026-02-18T00:17:57.882 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:17:57.883 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841545 2026-02-18T00:17:57.883 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:17:57.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:17:57.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-283467841545 2026-02-18T00:17:57.884 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:17:57.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=283467841545 2026-02-18T00:17:57.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 283467841545' 2026-02-18T00:17:57.885 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 283467841545 2026-02-18T00:17:57.886 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841543 -lt 283467841545 2026-02-18T00:17:58.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:17:59.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:17:59.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:17:59.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841543 -lt 283467841545 2026-02-18T00:17:59.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:18:00.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:18:00.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:18:00.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841545 -lt 283467841545 2026-02-18T00:18:00.580 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:00.581 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182422 2026-02-18T00:18:00.581 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:00.581 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:18:00.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182422 2026-02-18T00:18:00.582 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:00.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182422 2026-02-18T00:18:00.583 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182422' 2026-02-18T00:18:00.584 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182422 2026-02-18T00:18:00.584 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:18:00.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182423 -lt 107374182422 2026-02-18T00:18:00.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:18:00.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:00.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:01.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:18:01.128 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:18:01.348 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:18:01.349 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:18:01.349 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:01.350 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:01.658 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:18:01.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:18:01.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:18:01.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:18:01.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:18:01.971 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-256 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-256 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:18:01.980 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-256 td/test-erasure-eio/COPY 2026-02-18T00:18:01.999 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:18:02.000 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:18:02.001 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72662-1-256 td/test-erasure-eio 2 256 add 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72662-1-256 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-18T00:18:02.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72662-1-256 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72662-1-256 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72662-1-256 2026-02-18T00:18:02.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-18T00:18:02.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-18T00:18:02.232 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-18T00:18:02.575 INFO:tasks.workunit.client.0.trial061.stderr:noout is set 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:02.585 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:02.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:02.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:02.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:02.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:18:02.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:18:02.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T00:18:02.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:18:02.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:02.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72662-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:02.984 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-18T00:18:02.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:02.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:18:02.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:18:02.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:18:02.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:18:02.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:18:02.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:02.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:18:02.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:02.987 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:18:02.987 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:02.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:02.989 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:18:02.990 INFO:tasks.workunit.client.0.trial061.stderr:start osd.2 2026-02-18T00:18:02.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:02.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:18:02.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:18:02.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:18:02.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:18:02.992 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:18:02.998 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:02.996+0000 7f3d7ea83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:02.999 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:02.998+0000 7f3d7ea83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:03.000 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:02.998+0000 7f3d7ea83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:03.143 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:03.141+0000 7f3d7ea83900 -1 Falling back to public interface 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:03.210 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:03.211 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:18:03.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:03.211 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:03.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:03.527 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:03.525+0000 7f3d7ea83900 -1 osd.2 85 log_to_monitors true 2026-02-18T00:18:04.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:04.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:04.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:04.436 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:04.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:04.436 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 up in weight 1 up_from 90 up_thru 78 down_at 87 last_clean_interval [66,85) [v2:127.0.0.1:6818/2126372349,v1:127.0.0.1:6819/2126372349] [v2:127.0.0.1:6820/2126372349,v1:127.0.0.1:6821/2126372349] exists,up aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:18:04.656 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:18:04.657 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:18:04.657 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:18:04.658 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:18:04.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:18:04.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:18:04.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:18:04.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:18:04.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:18:04.743 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:18:04.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:18:04.966 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:04.967 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:18:04.967 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:18:04.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:18:04.967 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:04.967 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:18:05.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803804 2026-02-18T00:18:05.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803804 2026-02-18T00:18:05.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803804' 2026-02-18T00:18:05.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:05.034 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:18:05.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350982 2026-02-18T00:18:05.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350982 2026-02-18T00:18:05.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803804 1-347892350982' 2026-02-18T00:18:05.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:05.098 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:18:05.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-18T00:18:05.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-18T00:18:05.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803804 1-347892350982 2-386547056643' 2026-02-18T00:18:05.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:05.162 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:18:05.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182426 2026-02-18T00:18:05.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182426 2026-02-18T00:18:05.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803804 1-347892350982 2-386547056643 3-107374182426' 2026-02-18T00:18:05.227 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:05.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803804 2026-02-18T00:18:05.228 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:05.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:18:05.229 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803804 2026-02-18T00:18:05.230 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:05.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803804 2026-02-18T00:18:05.231 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803804' 2026-02-18T00:18:05.231 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803804 2026-02-18T00:18:05.231 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:05.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803804 -lt 25769803804 2026-02-18T00:18:05.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:05.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350982 2026-02-18T00:18:05.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:05.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:18:05.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350982 2026-02-18T00:18:05.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:05.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350982 2026-02-18T00:18:05.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350982' 2026-02-18T00:18:05.465 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 347892350982 2026-02-18T00:18:05.465 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:05.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350982 -lt 347892350982 2026-02-18T00:18:05.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:05.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-386547056643 2026-02-18T00:18:05.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:05.692 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:18:05.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-386547056643 2026-02-18T00:18:05.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:05.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056643 2026-02-18T00:18:05.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 386547056643' 2026-02-18T00:18:05.694 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 386547056643 2026-02-18T00:18:05.694 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:18:05.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-18T00:18:05.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:05.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182426 2026-02-18T00:18:05.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:05.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:18:05.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182426 2026-02-18T00:18:05.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:05.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182426 2026-02-18T00:18:05.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182426' 2026-02-18T00:18:05.921 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182426 2026-02-18T00:18:05.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:18:06.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182426 -lt 107374182426 2026-02-18T00:18:06.148 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:18:06.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:06.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:06.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:18:06.460 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:18:06.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:18:06.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:18:06.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:18:06.461 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:18:06.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:18:06.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:18:06.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:18:06.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:18:06.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:06.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:06.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:18:06.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:18:06.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:18:06.988 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records in 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:1+0 records out 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:256 bytes copied, 2.2262e-05 s, 11.5 MB/s 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:18:06.990 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:06.991 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:07.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72662-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-18T00:18:07.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:07.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:07.236 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:18:07.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:18:07.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:18:07.238 INFO:tasks.workunit.client.0.trial061.stderr:start osd.2 2026-02-18T00:18:07.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:07.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:18:07.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:18:07.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:18:07.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:18:07.239 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:18:07.251 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:07.249+0000 7fe6fd7a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:07.252 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:07.250+0000 7fe6fd7a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:07.253 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:07.251+0000 7fe6fd7a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:07.385 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:07.382+0000 7fe6fd7a1900 -1 Falling back to public interface 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:07.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:07.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:07.463 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:18:07.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:07.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:07.662 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:07.660+0000 7fe6fd7a1900 -1 osd.2 91 log_to_monitors true 2026-02-18T00:18:07.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:08.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:08.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:08.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:08.690 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:08.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:08.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:08.921 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 up in weight 1 up_from 95 up_thru 78 down_at 92 last_clean_interval [90,91) [v2:127.0.0.1:6818/3793671255,v1:127.0.0.1:6819/3793671255] [v2:127.0.0.1:6820/3793671255,v1:127.0.0.1:6821/3793671255] exists,up aa995ccb-74b6-47c3-a2fc-c1ddd6b881ef 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:18:08.922 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:18:08.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:18:08.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:18:08.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:18:09.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:18:09.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:18:09.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:18:09.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:18:09.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:18:09.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:09.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:18:09.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803807 2026-02-18T00:18:09.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803807 2026-02-18T00:18:09.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803807' 2026-02-18T00:18:09.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:09.312 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:18:09.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-18T00:18:09.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-18T00:18:09.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803807 1-347892350985' 2026-02-18T00:18:09.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:09.376 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:18:09.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893123 2026-02-18T00:18:09.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893123 2026-02-18T00:18:09.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803807 1-347892350985 2-408021893123' 2026-02-18T00:18:09.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:09.443 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:18:09.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182429 2026-02-18T00:18:09.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182429 2026-02-18T00:18:09.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803807 1-347892350985 2-408021893123 3-107374182429' 2026-02-18T00:18:09.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:09.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803807 2026-02-18T00:18:09.511 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:09.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:18:09.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803807 2026-02-18T00:18:09.512 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:09.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803807 2026-02-18T00:18:09.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803807' 2026-02-18T00:18:09.514 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803807 2026-02-18T00:18:09.514 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:09.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803807 -lt 25769803807 2026-02-18T00:18:09.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:09.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350985 2026-02-18T00:18:09.740 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:09.740 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:18:09.741 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:09.741 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350985 2026-02-18T00:18:09.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350985 2026-02-18T00:18:09.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350985' 2026-02-18T00:18:09.742 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 347892350985 2026-02-18T00:18:09.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:09.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350983 -lt 347892350985 2026-02-18T00:18:09.965 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:18:10.966 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:18:10.967 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:11.190 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350983 -lt 347892350985 2026-02-18T00:18:11.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:18:12.191 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:18:12.192 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:12.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350986 -lt 347892350985 2026-02-18T00:18:12.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:12.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-408021893123 2026-02-18T00:18:12.417 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:12.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:18:12.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-408021893123 2026-02-18T00:18:12.418 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:12.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=408021893123 2026-02-18T00:18:12.419 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 408021893123' 2026-02-18T00:18:12.419 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 408021893123 2026-02-18T00:18:12.420 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:18:12.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 408021893123 -lt 408021893123 2026-02-18T00:18:12.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:12.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182429 2026-02-18T00:18:12.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:12.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:18:12.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182429 2026-02-18T00:18:12.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:12.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182429 2026-02-18T00:18:12.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182429' 2026-02-18T00:18:12.651 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 107374182429 2026-02-18T00:18:12.651 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:18:12.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182429 -lt 107374182429 2026-02-18T00:18:12.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:18:12.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:12.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:13.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:18:13.187 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:18:13.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:18:13.187 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:18:13.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:18:13.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:18:13.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:18:13.188 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:18:13.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:18:13.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:18:13.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:13.410 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:13.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:18:13.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:18:13.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:18:13.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-18T00:18:13.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-18T00:18:14.042 INFO:tasks.workunit.client.0.trial061.stderr:noout is unset 2026-02-18T00:18:14.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-18T00:18:14.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72662-1-256 2026-02-18T00:18:14.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:14.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:14.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72662-1-256 2026-02-18T00:18:14.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:18:14.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:18:14.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72662-1-256 td/test-erasure-eio/COPY 2026-02-18T00:18:14.072 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:18:14.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:18:14.074 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:18:14.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:346: TEST_rados_get_bad_size_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:18:14.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:18:14.075 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:18:14.306 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:18:14.315 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:18:14.596 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:18:14.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:14.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:14.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:14.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:14.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:14.716 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:14.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:14.718 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:14.718 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:14.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:14.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:14.719 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:14.720 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:14.720 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:14.721 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:14.721 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:14.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:14.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.739 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.739 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:14.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:14.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:14.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:18:14.741 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:14.742 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:14.743 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:14.743 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:14.744 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:14.744 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:14.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:14.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:14.745 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:14.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:14.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:14.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:14.747 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:14.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:14.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:14.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:14.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:14.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:14.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:14.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:14.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:18:14.752 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:18:14.752 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.752 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:18:14.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:18:14.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:18:14.754 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:18:14.755 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:18:14.776 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:18:14.776 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:14.776 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:14.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:14.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:14.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:18:14.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:18:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:18:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:18:14.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:14.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:14.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:14.853 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:14.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:18:14.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:18:14.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:15.004 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:15.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:15.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:15.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:15.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:18:15.023 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:18:15.120 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:18:15.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:18:16.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:18:16.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:16.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:16.129 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:16.130 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:16.130 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:16.130 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:16.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:18:16.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:18:16.171 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:18:16.175 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:18:16.176 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:14.793+0000 7f48f3cedd80 0 load: jerasure load: lrc 2026-02-18T00:18:16.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_0 td/test-erasure-eio 2026-02-18T00:18:16.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:275: TEST_rados_get_subread_eio_shard_0: local dir=td/test-erasure-eio 2026-02-18T00:18:16.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:276: TEST_rados_get_subread_eio_shard_0: setup_osds 4 2026-02-18T00:18:16.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:18:16.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:18:16.178 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:18:16.178 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:16.182 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:16.183 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:16.184 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:18:16.185 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:16.185 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fb371cca-1f37-4056-a023-f737f7e53392 2026-02-18T00:18:16.185 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 fb371cca-1f37-4056-a023-f737f7e53392 2026-02-18T00:18:16.186 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 fb371cca-1f37-4056-a023-f737f7e53392' 2026-02-18T00:18:16.186 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:16.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBIBZVp1n5zCxAAIF8d8KC/XD9r591I32HB1Q== 2026-02-18T00:18:16.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBIBZVp1n5zCxAAIF8d8KC/XD9r591I32HB1Q=="}' 2026-02-18T00:18:16.194 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fb371cca-1f37-4056-a023-f737f7e53392 -i td/test-erasure-eio/0/new.json 2026-02-18T00:18:16.298 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:16.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:18:16.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBIBZVp1n5zCxAAIF8d8KC/XD9r591I32HB1Q== --osd-uuid fb371cca-1f37-4056-a023-f737f7e53392 2026-02-18T00:18:16.324 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.321+0000 7f8165556900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.325 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.323+0000 7f8165556900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.326 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.324+0000 7f8165556900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.327 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.324+0000 7f8165556900 -1 bdev(0x56442adb4c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:16.327 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.324+0000 7f8165556900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:18:16.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:18:16.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:16.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:18:16.784 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:18:16.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:16.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:18:16.898 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:18:16.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:16.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:16.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:16.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:16.915 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.912+0000 7f97733e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.916 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.914+0000 7f97733e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.917 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:16.915+0000 7f97733e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:16.998 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:17.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:17.125 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:17.123+0000 7f97733e0900 -1 Falling back to public interface 2026-02-18T00:18:17.405 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:17.402+0000 7f97733e0900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:18:18.103 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:18.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:18.104 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:18.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:18.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:18.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:18.326 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4037971445,v1:127.0.0.1:6803/4037971445] [v2:127.0.0.1:6804/4037971445,v1:127.0.0.1:6805/4037971445] exists,up fb371cca-1f37-4056-a023-f737f7e53392 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:18:18.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:18.331 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:18.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=58402143-14df-46e9-b268-a06b073bcd08 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 58402143-14df-46e9-b268-a06b073bcd08' 2026-02-18T00:18:18.333 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 58402143-14df-46e9-b268-a06b073bcd08 2026-02-18T00:18:18.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:18.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBKBZVpUTs2FBAAeTMCQv4ZiNx5xb4b2fZNfA== 2026-02-18T00:18:18.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBKBZVpUTs2FBAAeTMCQv4ZiNx5xb4b2fZNfA=="}' 2026-02-18T00:18:18.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 58402143-14df-46e9-b268-a06b073bcd08 -i td/test-erasure-eio/1/new.json 2026-02-18T00:18:18.569 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:18.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:18:18.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBKBZVpUTs2FBAAeTMCQv4ZiNx5xb4b2fZNfA== --osd-uuid 58402143-14df-46e9-b268-a06b073bcd08 2026-02-18T00:18:18.595 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:18.592+0000 7f1202413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:18.597 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:18.594+0000 7f1202413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:18.598 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:18.595+0000 7f1202413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:18.598 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:18.595+0000 7f1202413900 -1 bdev(0x559f74424c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:18.598 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:18.595+0000 7f1202413900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:18:18.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:18:18.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:18.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:18:18.915 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:18:18.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:19.229 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:18:19.229 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:18:19.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:19.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:19.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:19.230 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:19.246 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:19.243+0000 7fb2004f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:19.247 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:19.244+0000 7fb2004f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:19.248 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:19.245+0000 7fb2004f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:19.382 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:19.379+0000 7fb2004f3900 -1 Falling back to public interface 2026-02-18T00:18:19.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:18:19.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:19.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:18:19.456 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:19.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:19.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:19.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:19.457 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:19.457 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:19.458 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:19.679 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:19.764 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:19.761+0000 7fb2004f3900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:18:20.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:20.681 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:20.681 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:20.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:20.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:20.682 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:20.912 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2274761433,v1:127.0.0.1:6811/2274761433] [v2:127.0.0.1:6812/2274761433,v1:127.0.0.1:6813/2274761433] exists,up 58402143-14df-46e9-b268-a06b073bcd08 2026-02-18T00:18:20.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:20.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:20.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:20.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:18:20.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:20.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=057e1ad7-7610-4474-aab2-34028c22ecc0 2026-02-18T00:18:20.920 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 057e1ad7-7610-4474-aab2-34028c22ecc0 2026-02-18T00:18:20.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 057e1ad7-7610-4474-aab2-34028c22ecc0' 2026-02-18T00:18:20.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:20.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMBZVp6Eo3NxAANaCwHYx5MKzWmozkVCs7+Q== 2026-02-18T00:18:20.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMBZVp6Eo3NxAANaCwHYx5MKzWmozkVCs7+Q=="}' 2026-02-18T00:18:20.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 057e1ad7-7610-4474-aab2-34028c22ecc0 -i td/test-erasure-eio/2/new.json 2026-02-18T00:18:21.153 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:18:21.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:18:21.162 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBMBZVp6Eo3NxAANaCwHYx5MKzWmozkVCs7+Q== --osd-uuid 057e1ad7-7610-4474-aab2-34028c22ecc0 2026-02-18T00:18:21.180 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.177+0000 7f3a67a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.181 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.178+0000 7f3a67a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.182 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.179+0000 7f3a67a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.183 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.180+0000 7f3a67a72900 -1 bdev(0x55e3b3fa2c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:21.183 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.180+0000 7f3a67a72900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:18:21.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:18:21.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:21.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:18:21.511 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:18:21.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:21.823 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:18:21.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:18:21.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:21.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:21.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:21.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:21.841 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.838+0000 7fbbba015900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.842 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.839+0000 7fbbba015900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.843 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.840+0000 7fbbba015900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:21.972 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:21.968+0000 7fbbba015900 -1 Falling back to public interface 2026-02-18T00:18:22.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:18:22.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:22.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:18:22.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:22.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:22.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:22.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:22.048 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:22.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:22.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:22.271 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:22.342 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:22.338+0000 7fbbba015900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:18:23.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:23.272 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:23.273 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:23.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:23.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:23.273 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:23.500 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3354947052,v1:127.0.0.1:6819/3354947052] [v2:127.0.0.1:6820/3354947052,v1:127.0.0.1:6821/3354947052] exists,up 057e1ad7-7610-4474-aab2-34028c22ecc0 2026-02-18T00:18:23.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:23.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:23.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:23.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:23.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:23.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7fa624bc-c1df-4221-b3f2-c85a6f09c594 2026-02-18T00:18:23.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7fa624bc-c1df-4221-b3f2-c85a6f09c594' 2026-02-18T00:18:23.509 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 7fa624bc-c1df-4221-b3f2-c85a6f09c594 2026-02-18T00:18:23.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:23.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBPBZVpH6CpHhAAeXBFNTXFnFfXAyagVxgoqQ== 2026-02-18T00:18:23.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBPBZVpH6CpHhAAeXBFNTXFnFfXAyagVxgoqQ=="}' 2026-02-18T00:18:23.517 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7fa624bc-c1df-4221-b3f2-c85a6f09c594 -i td/test-erasure-eio/3/new.json 2026-02-18T00:18:23.744 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:18:23.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:18:23.753 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBPBZVpH6CpHhAAeXBFNTXFnFfXAyagVxgoqQ== --osd-uuid 7fa624bc-c1df-4221-b3f2-c85a6f09c594 2026-02-18T00:18:23.771 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:23.768+0000 7f70ee413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:23.772 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:23.769+0000 7f70ee413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:23.773 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:23.770+0000 7f70ee413900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:23.774 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:23.771+0000 7f70ee413900 -1 bdev(0x5653f0448c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:23.774 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:23.771+0000 7f70ee413900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:18:24.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:18:24.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:24.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:18:24.114 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:18:24.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:24.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:24.444 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:24.441+0000 7f3d83495900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:24.445 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:24.442+0000 7f3d83495900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:24.446 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:24.443+0000 7f3d83495900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:24.570 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:24.567+0000 7f3d83495900 -1 Falling back to public interface 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:24.653 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:18:24.839 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:24.836+0000 7f3d83495900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:18:24.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:25.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:18:26.110 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/4140486188,v1:127.0.0.1:6827/4140486188] [v2:127.0.0.1:6828/4140486188,v1:127.0.0.1:6829/4140486188] exists,up 7fa624bc-c1df-4221-b3f2-c85a6f09c594 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:26.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:26.112 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:18:26.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:18:26.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:18:26.158 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:18:26.161 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:17.126+0000 7f97733e0900 0 load: jerasure load: lrc 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:278: TEST_rados_get_subread_eio_shard_0: local poolname=pool-jerasure 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:279: TEST_rados_get_subread_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:18:26.164 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:18:26.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:18:26.451 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:18:26.821 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:18:26.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:18:27.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:18:27.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:18:27.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:18:27.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:18:27.831 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:18:27.833 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:18:27.833 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:18:27.834 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:18:27.834 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:18:27.834 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:18:27.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:18:27.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:18:27.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:18:27.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:18:27.923 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:18:27.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:28.147 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:18:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-18T00:18:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-18T00:18:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-18T00:18:28.214 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:28.214 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:18:28.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607556 2026-02-18T00:18:28.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607556 2026-02-18T00:18:28.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556' 2026-02-18T00:18:28.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:28.278 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:18:28.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444036 2026-02-18T00:18:28.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444036 2026-02-18T00:18:28.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-73014444036' 2026-02-18T00:18:28.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:28.342 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:18:28.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215107 2026-02-18T00:18:28.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215107 2026-02-18T00:18:28.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-73014444036 3-103079215107' 2026-02-18T00:18:28.406 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:28.406 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-18T00:18:28.406 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:28.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:18:28.407 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-18T00:18:28.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:28.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-18T00:18:28.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-18T00:18:28.409 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803780 2026-02-18T00:18:28.409 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:28.632 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-18T00:18:28.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:18:29.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:18:29.634 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:29.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-18T00:18:29.864 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:29.864 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607556 2026-02-18T00:18:29.864 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:29.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:18:29.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607556 2026-02-18T00:18:29.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:29.868 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607556 2026-02-18T00:18:29.868 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607556' 2026-02-18T00:18:29.868 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607556 2026-02-18T00:18:29.869 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:30.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607556 -lt 51539607556 2026-02-18T00:18:30.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:30.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444036 2026-02-18T00:18:30.094 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:30.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:18:30.095 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444036 2026-02-18T00:18:30.095 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:30.096 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444036 2026-02-18T00:18:30.096 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 73014444036 2026-02-18T00:18:30.097 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444036' 2026-02-18T00:18:30.097 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:18:30.317 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444037 -lt 73014444036 2026-02-18T00:18:30.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:30.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215107 2026-02-18T00:18:30.318 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:30.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:18:30.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215107 2026-02-18T00:18:30.319 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:30.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215107 2026-02-18T00:18:30.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215107' 2026-02-18T00:18:30.321 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 103079215107 2026-02-18T00:18:30.321 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:18:30.544 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215107 -lt 103079215107 2026-02-18T00:18:30.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:18:30.545 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:30.546 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:30.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:18:30.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:18:30.854 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:18:30.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:18:30.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:18:30.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:18:30.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:18:30.855 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:18:31.080 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:18:31.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:18:31.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:31.081 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:281: TEST_rados_get_subread_eio_shard_0: local shard_id=0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:282: TEST_rados_get_subread_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72662-0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72662-0 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:18:31.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72662-0 td/test-erasure-eio/ORIGINAL 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-0 td/test-erasure-eio 0 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-0 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:18:31.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-0 2026-02-18T00:18:31.417 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.417 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:18:31.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:18:31.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:18:31.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:31.648 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:31.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:18:31.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:18:31.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:18:31.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:18:31.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:18:31.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-72662-0 0 2026-02-18T00:18:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:31.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-0 2026-02-18T00:18:31.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:18:31.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:18:31.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72662-0 td/test-erasure-eio/COPY 2026-02-18T00:18:31.771 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:18:31.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:18:31.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-18T00:18:31.773 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 0 + 1 2026-02-18T00:18:31.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=1 2026-02-18T00:18:31.775 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-0 td/test-erasure-eio 1 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-0 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:18:31.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-0 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-0 2026-02-18T00:18:31.777 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:18:32.008 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:18:32.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T00:18:32.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:18:32.009 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:18:32.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:18:32.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:18:32.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:18:32.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:18:32.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.062 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:18:32.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:18:32.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72662-0 1 2026-02-18T00:18:32.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-18T00:18:32.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-0 fail 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-0 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-18T00:18:32.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-eio-72662-0 td/test-erasure-eio/COPY 2026-02-18T00:18:32.130 INFO:tasks.workunit.client.0.trial061.stderr:error getting pool-jerasure/obj-eio-72662-0: (5) Input/output error 2026-02-18T00:18:32.131 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-18T00:18:32.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:18:32.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:283: TEST_rados_get_subread_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:18:32.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:18:32.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:18:32.402 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:18:32.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:18:32.681 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:18:32.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:18:32.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:32.690 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:32.799 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:32.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:32.800 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:32.801 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:32.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:32.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:32.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:32.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:32.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:32.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:32.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:32.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:32.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:32.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:32.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:32.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:32.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:32.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:32.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:32.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:32.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:32.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:32.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:32.821 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:32.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:32.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:32.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:32.822 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:32.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:32.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:32.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:32.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:32.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:32.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:32.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:32.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:18:32.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:18:32.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.828 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:18:32.829 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:18:32.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:18:32.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:18:32.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:18:32.830 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:18:32.831 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.851 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:32.852 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:18:32.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:18:32.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:18:32.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:32.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:32.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:18:32.879 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:32.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:18:32.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:18:32.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:32.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:32.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:18:32.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:18:32.925 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:32.925 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:32.925 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:32.925 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:32.925 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:32.926 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:32.926 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:32.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:32.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:18:32.969 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:18:33.071 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:18:33.071 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:33.072 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:33.073 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:33.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:18:33.091 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:18:33.188 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:18:33.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:18:34.197 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:18:34.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:18:34.238 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:18:34.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:18:34.244 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:32.867+0000 7f56e4c18d80 0 load: jerasure load: lrc 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_1 td/test-erasure-eio 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:287: TEST_rados_get_subread_eio_shard_1: local dir=td/test-erasure-eio 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:288: TEST_rados_get_subread_eio_shard_1: setup_osds 4 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:18:34.245 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:18:34.246 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:34.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:34.251 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:34.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:34.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:34.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:18:34.253 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:34.253 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=07698858-6d9c-4973-8097-6b89f5b96203 2026-02-18T00:18:34.253 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 07698858-6d9c-4973-8097-6b89f5b96203 2026-02-18T00:18:34.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 07698858-6d9c-4973-8097-6b89f5b96203' 2026-02-18T00:18:34.254 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:34.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBaBZVpY2+BDxAAYvKfW2PUKKtxZ0ivS9Hlow== 2026-02-18T00:18:34.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBaBZVpY2+BDxAAYvKfW2PUKKtxZ0ivS9Hlow=="}' 2026-02-18T00:18:34.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 07698858-6d9c-4973-8097-6b89f5b96203 -i td/test-erasure-eio/0/new.json 2026-02-18T00:18:34.367 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:34.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:18:34.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBaBZVpY2+BDxAAYvKfW2PUKKtxZ0ivS9Hlow== --osd-uuid 07698858-6d9c-4973-8097-6b89f5b96203 2026-02-18T00:18:34.393 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.390+0000 7f1b8b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:34.394 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.392+0000 7f1b8b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:34.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.392+0000 7f1b8b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:34.396 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.393+0000 7f1b8b210900 -1 bdev(0x556faca8ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:34.396 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.393+0000 7f1b8b210900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:18:34.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:18:34.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:34.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:18:34.805 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:18:34.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:34.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:18:34.912 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:18:34.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:34.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:34.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:34.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:34.929 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.926+0000 7f15b9542900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:34.930 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.927+0000 7f15b9542900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:34.931 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:34.928+0000 7f15b9542900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:35.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:35.010 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:35.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:35.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:35.110 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:35.110 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:35.107+0000 7f15b9542900 -1 Falling back to public interface 2026-02-18T00:18:35.372 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:35.369+0000 7f15b9542900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:18:36.111 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:36.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:36.112 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:36.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:36.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:36.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:36.336 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/424578370,v1:127.0.0.1:6803/424578370] [v2:127.0.0.1:6804/424578370,v1:127.0.0.1:6805/424578370] exists,up 07698858-6d9c-4973-8097-6b89f5b96203 2026-02-18T00:18:36.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:36.340 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:36.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:36.342 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:36.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2d8b900d-edc8-4e10-b5e2-be7438c1a4f7 2026-02-18T00:18:36.344 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 2d8b900d-edc8-4e10-b5e2-be7438c1a4f7 2026-02-18T00:18:36.345 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 2d8b900d-edc8-4e10-b5e2-be7438c1a4f7' 2026-02-18T00:18:36.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:36.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBcBZVper3hFBAAGkFAdvqVpXfz9yNHOfJFDg== 2026-02-18T00:18:36.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBcBZVper3hFBAAGkFAdvqVpXfz9yNHOfJFDg=="}' 2026-02-18T00:18:36.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2d8b900d-edc8-4e10-b5e2-be7438c1a4f7 -i td/test-erasure-eio/1/new.json 2026-02-18T00:18:36.581 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:36.589 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:18:36.590 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBcBZVper3hFBAAGkFAdvqVpXfz9yNHOfJFDg== --osd-uuid 2d8b900d-edc8-4e10-b5e2-be7438c1a4f7 2026-02-18T00:18:36.607 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:36.604+0000 7fd89f724900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:36.608 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:36.605+0000 7fd89f724900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:36.609 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:36.606+0000 7fd89f724900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:36.610 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:36.607+0000 7fd89f724900 -1 bdev(0x56276e23ec00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:36.610 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:36.607+0000 7fd89f724900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:18:36.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:18:36.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:36.937 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:18:36.938 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:18:36.938 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:37.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:18:37.257 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:18:37.257 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:37.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:37.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:37.258 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:37.274 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:37.271+0000 7f2b482a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:37.275 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:37.272+0000 7f2b482a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:37.276 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:37.273+0000 7f2b482a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:37.414 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:37.411+0000 7f2b482a1900 -1 Falling back to public interface 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:37.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:37.480 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:37.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:37.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:37.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:37.710 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:37.707+0000 7f2b482a1900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:18:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:38.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:38.702 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:38.702 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:38.927 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3780705218,v1:127.0.0.1:6811/3780705218] [v2:127.0.0.1:6812/3780705218,v1:127.0.0.1:6813/3780705218] exists,up 2d8b900d-edc8-4e10-b5e2-be7438c1a4f7 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:38.931 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:38.932 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:38.933 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9e5f2a3c-df3c-435a-bcde-7e30e7b78d01 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9e5f2a3c-df3c-435a-bcde-7e30e7b78d01' 2026-02-18T00:18:38.934 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 9e5f2a3c-df3c-435a-bcde-7e30e7b78d01 2026-02-18T00:18:38.935 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:38.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBeBZVp0ZkQOBAA1srgKmjJBGkdz5hU2nJJyA== 2026-02-18T00:18:38.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBeBZVp0ZkQOBAA1srgKmjJBGkdz5hU2nJJyA=="}' 2026-02-18T00:18:38.943 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9e5f2a3c-df3c-435a-bcde-7e30e7b78d01 -i td/test-erasure-eio/2/new.json 2026-02-18T00:18:39.170 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:18:39.177 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:18:39.178 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBeBZVp0ZkQOBAA1srgKmjJBGkdz5hU2nJJyA== --osd-uuid 9e5f2a3c-df3c-435a-bcde-7e30e7b78d01 2026-02-18T00:18:39.196 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.193+0000 7ff529f9f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:39.198 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.195+0000 7ff529f9f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:39.199 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.196+0000 7ff529f9f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:39.199 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.196+0000 7ff529f9f900 -1 bdev(0x55b6e47bac00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:39.199 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.196+0000 7ff529f9f900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:18:39.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:18:39.511 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:39.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:18:39.512 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:18:39.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:39.825 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:18:39.825 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:18:39.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:39.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:39.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:39.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:39.843 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.840+0000 7f5f0fcf8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:39.844 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.841+0000 7f5f0fcf8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:39.845 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:39.842+0000 7f5f0fcf8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:40.039 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:40.036+0000 7f5f0fcf8900 -1 Falling back to public interface 2026-02-18T00:18:40.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:18:40.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:40.047 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:40.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:40.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:40.275 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:40.408 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:40.405+0000 7f5f0fcf8900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:18:41.276 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:41.277 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:41.277 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:41.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:41.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:41.278 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:41.502 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1151795450,v1:127.0.0.1:6819/1151795450] [v2:127.0.0.1:6820/1151795450,v1:127.0.0.1:6821/1151795450] exists,up 9e5f2a3c-df3c-435a-bcde-7e30e7b78d01 2026-02-18T00:18:41.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:41.507 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:41.508 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:41.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d312aa6f-3568-435b-bd0b-0c5518d2a7d5 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 d312aa6f-3568-435b-bd0b-0c5518d2a7d5' 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 d312aa6f-3568-435b-bd0b-0c5518d2a7d5 2026-02-18T00:18:41.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:41.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBhBZVpBfS/HhAARgyiCUv70bBeakSBVJ/N8A== 2026-02-18T00:18:41.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBhBZVpBfS/HhAARgyiCUv70bBeakSBVJ/N8A=="}' 2026-02-18T00:18:41.518 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d312aa6f-3568-435b-bd0b-0c5518d2a7d5 -i td/test-erasure-eio/3/new.json 2026-02-18T00:18:41.751 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:18:41.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:18:41.759 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBhBZVpBfS/HhAARgyiCUv70bBeakSBVJ/N8A== --osd-uuid d312aa6f-3568-435b-bd0b-0c5518d2a7d5 2026-02-18T00:18:41.778 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:41.775+0000 7f9271f90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:41.779 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:41.776+0000 7f9271f90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:41.780 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:41.777+0000 7f9271f90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:41.781 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:41.778+0000 7f9271f90900 -1 bdev(0x55cbbbafec00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:41.781 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:41.778+0000 7f9271f90900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:18:42.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:18:42.112 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:42.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:18:42.113 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:18:42.113 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:42.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:18:42.426 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:18:42.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:42.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:42.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:42.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:42.444 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:42.441+0000 7f858c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:42.445 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:42.442+0000 7f858c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:42.446 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:42.443+0000 7f858c20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:42.586 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:42.583+0000 7f858c20f900 -1 Falling back to public interface 2026-02-18T00:18:42.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:18:42.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:42.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:18:42.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:42.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:42.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:42.650 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:42.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:42.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:42.651 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:18:42.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:42.913 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:42.910+0000 7f858c20f900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:18:43.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:43.888 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:43.888 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:43.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:43.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:43.889 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:18:44.112 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1247684721,v1:127.0.0.1:6827/1247684721] [v2:127.0.0.1:6828/1247684721,v1:127.0.0.1:6829/1247684721] exists,up d312aa6f-3568-435b-bd0b-0c5518d2a7d5 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:44.114 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:18:44.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:18:44.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:18:44.160 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:18:44.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:18:44.167 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:35.110+0000 7f15b9542900 0 load: jerasure load: lrc 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:290: TEST_rados_get_subread_eio_shard_1: local poolname=pool-jerasure 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:291: TEST_rados_get_subread_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:18:44.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:18:44.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:18:44.453 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:18:44.829 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:18:44.837 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:18:45.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:18:45.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:18:45.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:18:45.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:18:45.841 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:18:45.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:18:45.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:18:45.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:18:45.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:18:45.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:18:45.929 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:18:46.153 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:18:46.153 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:46.154 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:18:46.154 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:18:46.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:18:46.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:46.154 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:18:46.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-18T00:18:46.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-18T00:18:46.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-18T00:18:46.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:46.216 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:18:46.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-18T00:18:46.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-18T00:18:46.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-18T00:18:46.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:46.281 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:18:46.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:18:46.347 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:18:46.348 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331' 2026-02-18T00:18:46.348 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:18:46.348 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:18:46.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-18T00:18:46.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-18T00:18:46.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331 3-107374182403' 2026-02-18T00:18:46.413 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:46.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-18T00:18:46.413 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:46.414 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:18:46.414 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-18T00:18:46.415 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:46.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-18T00:18:46.415 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-18T00:18:46.416 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803780 2026-02-18T00:18:46.416 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:46.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-18T00:18:46.643 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:18:47.644 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:18:47.644 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:18:47.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-18T00:18:47.871 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:47.872 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-18T00:18:47.872 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:47.872 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:18:47.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-18T00:18:47.873 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:47.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-18T00:18:47.874 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-18T00:18:47.875 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574852 2026-02-18T00:18:47.875 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:18:48.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-18T00:18:48.098 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:48.098 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-18T00:18:48.099 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:48.099 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:18:48.100 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-18T00:18:48.100 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:48.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:18:48.101 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-18T00:18:48.101 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411331 2026-02-18T00:18:48.102 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:18:48.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-18T00:18:48.325 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:18:48.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182403 2026-02-18T00:18:48.325 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:18:48.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:18:48.327 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182403 2026-02-18T00:18:48.327 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:18:48.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182403 2026-02-18T00:18:48.328 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-18T00:18:48.329 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182403 2026-02-18T00:18:48.329 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:18:48.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-18T00:18:48.555 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:18:48.555 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:48.555 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:48.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:18:48.865 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:18:48.866 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:18:49.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:18:49.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:18:49.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:18:49.086 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:18:49.397 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:293: TEST_rados_get_subread_eio_shard_1: local shard_id=1 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:294: TEST_rados_get_subread_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-18T00:18:49.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72662-1 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72662-1 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:18:49.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:18:49.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:18:49.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72662-1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:18:49.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-1 td/test-erasure-eio 1 2026-02-18T00:18:49.417 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-1 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:18:49.418 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:18:49.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:18:49.419 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-1 2026-02-18T00:18:49.419 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.419 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:18:49.645 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:18:49.645 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:49.645 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:18:49.646 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-18T00:18:49.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:18:49.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T00:18:49.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:18:49.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:18:49.648 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:18:49.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:49.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:49.649 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:49.649 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:18:49.649 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:18:49.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:18:49.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:49.700 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:49.701 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:49.701 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:18:49.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:18:49.701 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72662-1 1 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-1 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:18:49.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72662-1 td/test-erasure-eio/COPY 2026-02-18T00:18:49.772 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:18:49.773 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:18:49.774 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-18T00:18:49.774 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-18T00:18:49.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=2 2026-02-18T00:18:49.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-1 td/test-erasure-eio 2 2026-02-18T00:18:49.776 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-1 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=2 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.777 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:18:49.778 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-1 2026-02-18T00:18:49.778 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-1 2026-02-18T00:18:49.778 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=2 2026-02-18T00:18:50.002 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:18:50.003 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/2/type 2026-02-18T00:18:50.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:18:50.004 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 2 bluestore_debug_inject_read_err true 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=2 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.2 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.005 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.2.asok 2026-02-18T00:18:50.006 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.2.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:18:50.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:18:50.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:18:50.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:18:50.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.2 2026-02-18T00:18:50.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-18T00:18:50.056 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-18T00:18:50.056 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:50.056 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.057 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.2.asok 2026-02-18T00:18:50.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:18:50.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.2.asok injectdataerr pool-jerasure obj-eio-72662-1 2 2026-02-18T00:18:50.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-18T00:18:50.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:188: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-1 2026-02-18T00:18:50.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:18:50.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:18:50.106 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-1 2026-02-18T00:18:50.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:18:50.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:18:50.107 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72662-1 td/test-erasure-eio/COPY 2026-02-18T00:18:50.125 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:18:50.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:18:50.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:18:50.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:295: TEST_rados_get_subread_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:18:50.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:18:50.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:18:50.398 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:18:50.405 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:18:50.679 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:18:50.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:18:50.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:50.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:50.688 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:50.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:50.688 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:50.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:50.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:50.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:50.797 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:50.798 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:50.799 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:50.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:50.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:50.801 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:50.801 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:50.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:50.802 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:50.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:50.803 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:50.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:50.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:50.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:50.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:50.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.813 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.813 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:50.814 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:18:50.815 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:18:50.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:18:50.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:18:50.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:18:50.816 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:18:50.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:18:50.817 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:18:50.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:18:50.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:18:50.819 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:18:50.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:50.819 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:18:50.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:18:50.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:18:50.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:18:50.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:18:50.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:18:50.823 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:18:50.823 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.823 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.823 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:18:50.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:18:50.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:18:50.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:18:50.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:18:50.825 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:18:50.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:18:50.828 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:18:50.829 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.848 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.849 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:50.849 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:18:50.875 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:18:50.876 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:50.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:50.878 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:18:50.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:18:50.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:18:50.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:18:50.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:18:50.923 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:18:50.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:18:50.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:50.924 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:50.924 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:50.924 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:50.925 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:50.925 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:50.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:18:50.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:18:50.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:18:51.069 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:18:51.069 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:51.070 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:51.071 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:18:51.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:18:51.088 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:18:51.185 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:18:51.192 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:18:52.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:18:52.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:18:52.194 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:18:52.194 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:18:52.195 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:52.195 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:52.195 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:18:52.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:18:52.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:18:52.236 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:18:52.241 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:18:52.242 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:50.865+0000 7f1ed0ff5d80 0 load: jerasure load: lrc 2026-02-18T00:18:52.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_missing td/test-erasure-eio 2026-02-18T00:18:52.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:302: TEST_rados_get_subread_missing: local dir=td/test-erasure-eio 2026-02-18T00:18:52.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:303: TEST_rados_get_subread_missing: setup_osds 4 2026-02-18T00:18:52.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:18:52.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:18:52.244 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:18:52.244 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:52.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:52.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:52.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:52.251 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=20e84c8e-d70d-49ac-ac17-70822105ad9c 2026-02-18T00:18:52.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 20e84c8e-d70d-49ac-ac17-70822105ad9c' 2026-02-18T00:18:52.252 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 20e84c8e-d70d-49ac-ac17-70822105ad9c 2026-02-18T00:18:52.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:52.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBsBZVpdt5sDxAAViHEYd6YLTHG5Wy75VFD8g== 2026-02-18T00:18:52.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBsBZVpdt5sDxAAViHEYd6YLTHG5Wy75VFD8g=="}' 2026-02-18T00:18:52.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 20e84c8e-d70d-49ac-ac17-70822105ad9c -i td/test-erasure-eio/0/new.json 2026-02-18T00:18:52.369 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:52.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:18:52.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBsBZVpdt5sDxAAViHEYd6YLTHG5Wy75VFD8g== --osd-uuid 20e84c8e-d70d-49ac-ac17-70822105ad9c 2026-02-18T00:18:52.395 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.393+0000 7f58d5757900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.397 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.395+0000 7f58d5757900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.398 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.396+0000 7f58d5757900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.398 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.396+0000 7f58d5757900 -1 bdev(0x55eef7e02c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:52.398 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.396+0000 7f58d5757900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:18:52.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:18:52.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:52.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:18:52.782 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:18:52.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:52.884 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:18:52.885 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:18:52.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:52.885 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:52.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:52.886 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:52.901 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.899+0000 7fce1b67f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.902 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.901+0000 7fce1b67f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.904 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:52.902+0000 7fce1b67f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:52.985 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:52.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:52.986 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:52.986 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:52.987 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:53.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:53.085 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:53.083+0000 7fce1b67f900 -1 Falling back to public interface 2026-02-18T00:18:53.349 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:53.347+0000 7fce1b67f900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:18:54.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:54.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:54.083 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:54.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:54.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:54.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:18:54.307 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1380658538,v1:127.0.0.1:6801/1380658538] [v2:127.0.0.1:6802/1380658538,v1:127.0.0.1:6803/1380658538] exists,up 20e84c8e-d70d-49ac-ac17-70822105ad9c 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:54.311 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:54.312 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:54.313 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 2026-02-18T00:18:54.314 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4' 2026-02-18T00:18:54.315 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 2026-02-18T00:18:54.315 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:54.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBuBZVpxVUgExAAHIiHM/4quiY1opNNm6GDhA== 2026-02-18T00:18:54.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBuBZVpxVUgExAAHIiHM/4quiY1opNNm6GDhA=="}' 2026-02-18T00:18:54.323 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 -i td/test-erasure-eio/1/new.json 2026-02-18T00:18:54.557 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:54.565 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:18:54.566 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBuBZVpxVUgExAAHIiHM/4quiY1opNNm6GDhA== --osd-uuid 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 2026-02-18T00:18:54.584 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:54.582+0000 7f8819213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:54.585 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:54.584+0000 7f8819213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:54.586 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:54.584+0000 7f8819213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:54.587 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:54.585+0000 7f8819213900 -1 bdev(0x55920ee0ac00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:54.587 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:54.585+0000 7f8819213900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:18:54.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:18:54.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:54.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:18:54.916 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:18:54.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:55.235 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:18:55.235 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:18:55.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:55.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:55.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:55.236 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:55.253 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:55.251+0000 7f1736eee900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:55.254 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:55.252+0000 7f1736eee900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:55.255 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:55.253+0000 7f1736eee900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:55.383 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:55.381+0000 7f1736eee900 -1 Falling back to public interface 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:55.459 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:55.681 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:55.679+0000 7f1736eee900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:18:55.684 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:56.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:56.686 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:56.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:56.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:56.687 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:18:56.913 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3923351071,v1:127.0.0.1:6811/3923351071] [v2:127.0.0.1:6812/3923351071,v1:127.0.0.1:6813/3923351071] exists,up 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 2026-02-18T00:18:56.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:56.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:56.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:56.918 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:56.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:56.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:56.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:18:56.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:56.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=19a86619-98d7-4db2-bbfe-b9fe125721fc 2026-02-18T00:18:56.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 19a86619-98d7-4db2-bbfe-b9fe125721fc' 2026-02-18T00:18:56.921 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 19a86619-98d7-4db2-bbfe-b9fe125721fc 2026-02-18T00:18:56.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:56.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBwBZVpLV9ANxAAvixWF27x5+o7BuoJVIJjuQ== 2026-02-18T00:18:56.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBwBZVpLV9ANxAAvixWF27x5+o7BuoJVIJjuQ=="}' 2026-02-18T00:18:56.929 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 19a86619-98d7-4db2-bbfe-b9fe125721fc -i td/test-erasure-eio/2/new.json 2026-02-18T00:18:57.159 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:18:57.167 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:18:57.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBwBZVpLV9ANxAAvixWF27x5+o7BuoJVIJjuQ== --osd-uuid 19a86619-98d7-4db2-bbfe-b9fe125721fc 2026-02-18T00:18:57.186 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.185+0000 7fb44aca8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.188 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.186+0000 7fb44aca8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.189 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.187+0000 7fb44aca8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.189 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.187+0000 7fb44aca8900 -1 bdev(0x55cbf2b0cc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:57.189 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.187+0000 7fb44aca8900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:18:57.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:18:57.505 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:18:57.505 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:18:57.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:18:57.506 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:18:57.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:18:57.817 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:18:57.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:18:57.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:18:57.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:18:57.818 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:18:57.834 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.832+0000 7f243b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.836 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.834+0000 7f243b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.837 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.835+0000 7f243b210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:57.980 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:57.978+0000 7f243b210900 -1 Falling back to public interface 2026-02-18T00:18:58.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:18:58.045 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:18:58.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:58.046 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:58.267 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:18:58.355 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:58.354+0000 7f243b210900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:18:59.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:18:59.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:18:59.269 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:18:59.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:18:59.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:18:59.270 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:18:59.496 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1735211229,v1:127.0.0.1:6819/1735211229] [v2:127.0.0.1:6820/1735211229,v1:127.0.0.1:6821/1735211229] exists,up 19a86619-98d7-4db2-bbfe-b9fe125721fc 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:18:59.500 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:18:59.501 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:18:59.502 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:18:59.503 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ba35f2b0-c900-4a83-88fe-27e2dffee5fc 2026-02-18T00:18:59.504 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 ba35f2b0-c900-4a83-88fe-27e2dffee5fc 2026-02-18T00:18:59.504 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 ba35f2b0-c900-4a83-88fe-27e2dffee5fc' 2026-02-18T00:18:59.504 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:18:59.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBzBZVpt1BgHhAAUEkUxWTaSjfj/sf9Ouc3Cw== 2026-02-18T00:18:59.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBzBZVpt1BgHhAAUEkUxWTaSjfj/sf9Ouc3Cw=="}' 2026-02-18T00:18:59.512 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ba35f2b0-c900-4a83-88fe-27e2dffee5fc -i td/test-erasure-eio/3/new.json 2026-02-18T00:18:59.740 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:18:59.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:18:59.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBzBZVpt1BgHhAAUEkUxWTaSjfj/sf9Ouc3Cw== --osd-uuid ba35f2b0-c900-4a83-88fe-27e2dffee5fc 2026-02-18T00:18:59.767 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:59.765+0000 7ff16a55f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:59.769 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:59.767+0000 7ff16a55f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:59.770 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:59.768+0000 7ff16a55f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:18:59.770 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:59.768+0000 7ff16a55f900 -1 bdev(0x558afee8ac00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:18:59.770 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:18:59.768+0000 7ff16a55f900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:19:00.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:19:00.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:00.086 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:19:00.086 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:19:00.087 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:00.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:19:00.399 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:19:00.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:00.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:00.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:00.400 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:00.415 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:00.413+0000 7f45383ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:00.417 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:00.415+0000 7f45383ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:00.418 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:00.416+0000 7f45383ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:00.546 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:00.544+0000 7f45383ba900 -1 Falling back to public interface 2026-02-18T00:19:00.620 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:19:00.620 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:00.620 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:19:00.620 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:00.620 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:00.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:00.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:00.621 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:00.621 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:00.622 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:00.838 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:00.860 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:00.858+0000 7f45383ba900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:19:01.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:01.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:01.840 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:01.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:01.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:01.841 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:02.065 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2118977551,v1:127.0.0.1:6827/2118977551] [v2:127.0.0.1:6828/2118977551,v1:127.0.0.1:6829/2118977551] exists,up ba35f2b0-c900-4a83-88fe-27e2dffee5fc 2026-02-18T00:19:02.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:02.066 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:19:02.067 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:19:02.113 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:19:02.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:19:02.118 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:18:53.086+0000 7fce1b67f900 0 load: jerasure load: lrc 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:305: TEST_rados_get_subread_missing: local poolname=pool-jerasure 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:306: TEST_rados_get_subread_missing: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:19:02.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:19:02.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:02.412 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:02.781 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:19:02.790 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:19:03.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:19:03.791 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:03.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:03.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:03.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:03.879 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:03.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:03.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:03.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:03.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:03.880 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:04.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:04.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:04.168 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-18T00:19:04.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-18T00:19:04.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-18T00:19:04.169 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:04.169 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:04.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607557 2026-02-18T00:19:04.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607557 2026-02-18T00:19:04.233 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557' 2026-02-18T00:19:04.234 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:04.234 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:04.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:19:04.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:19:04.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557 2-77309411331' 2026-02-18T00:19:04.299 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:04.299 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:04.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116996 2026-02-18T00:19:04.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116996 2026-02-18T00:19:04.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557 2-77309411331 3-115964116996' 2026-02-18T00:19:04.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:04.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:04.363 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:04.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:04.364 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:04.364 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:04.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-18T00:19:04.365 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-18T00:19:04.365 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803780 2026-02-18T00:19:04.366 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:04.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-18T00:19:04.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:05.598 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:19:05.599 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:05.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-18T00:19:05.824 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:05.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607557 2026-02-18T00:19:05.824 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:05.826 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:19:05.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607557 2026-02-18T00:19:05.826 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:05.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607557 2026-02-18T00:19:05.827 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607557' 2026-02-18T00:19:05.827 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 51539607557 2026-02-18T00:19:05.827 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:19:06.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607557 -lt 51539607557 2026-02-18T00:19:06.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:06.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-18T00:19:06.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:06.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:19:06.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-18T00:19:06.052 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:06.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:19:06.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-18T00:19:06.054 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411331 2026-02-18T00:19:06.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:06.281 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-18T00:19:06.282 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:06.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116996 2026-02-18T00:19:06.282 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:06.283 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:19:06.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116996 2026-02-18T00:19:06.284 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:06.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116996 2026-02-18T00:19:06.285 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116996' 2026-02-18T00:19:06.285 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116996 2026-02-18T00:19:06.286 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:19:06.509 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116996 -lt 115964116996 2026-02-18T00:19:06.509 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:19:06.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:06.510 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:06.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:19:06.820 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:19:06.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:19:06.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:19:06.820 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:19:06.821 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:19:06.821 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:19:06.821 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:19:07.045 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:19:07.045 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:19:07.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:07.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:308: TEST_rados_get_subread_missing: local shard_id=1 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:309: TEST_rados_get_subread_missing: rados_put_get_data remove td/test-erasure-eio 1 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=remove 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-18T00:19:07.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-remove-72662-1 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-remove-72662-1 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-remove-72662-1 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:19:07.358 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:19:07.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-remove-72662-1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-72662-1 td/test-erasure-eio 1 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-18T00:19:07.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-72662-1 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=1 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-72662-1 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-remove-72662-1 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-remove-72662-1 2026-02-18T00:19:07.377 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:19:07.602 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:19:07.602 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:07.602 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=1 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 1 obj-remove-72662-1 remove 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-remove-72662-1 remove 2026-02-18T00:19:07.603 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:07.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:07.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:07.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-remove-72662-1 remove 2026-02-18T00:19:07.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:19:07.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:19:07.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-18T00:19:07.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:19:07.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-18T00:19:07.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-remove-72662-1 remove 2026-02-18T00:19:08.024 INFO:tasks.workunit.client.0.trial061.stdout:remove 1#2:0dea531e:::obj-remove-72662-1:head# 2026-02-18T00:19:08.059 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:19:08.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:08.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:start osd.1 2026-02-18T00:19:08.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:08.063 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-18T00:19:08.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-18T00:19:08.063 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:19:08.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:19:08.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:19:08.075 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:08.073+0000 7fd0d1a83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:08.077 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:08.075+0000 7fd0d1a83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:08.078 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:08.076+0000 7fd0d1a83900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:08.207 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:08.205+0000 7fd0d1a83900 -1 Falling back to public interface 2026-02-18T00:19:08.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-18T00:19:08.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:08.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:19:08.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:08.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:08.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:08.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:08.290 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:19:08.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:08.290 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:08.512 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:08.510+0000 7fd0d1a83900 -1 osd.1 34 log_to_monitors true 2026-02-18T00:19:08.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:09.515 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:09.751 INFO:tasks.workunit.client.0.trial061.stderr:osd.1 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [12,34) [v2:127.0.0.1:6810/2289118693,v1:127.0.0.1:6811/2289118693] [v2:127.0.0.1:6812/2289118693,v1:127.0.0.1:6813/2289118693] exists,up 7cca0a47-cc0f-4bdd-9bfe-f100925ffbc4 2026-02-18T00:19:09.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:09.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:09.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:09.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:09.752 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:09.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:09.753 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:09.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:09.839 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:09.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:09.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:09.840 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:09.840 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:10.064 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:10.065 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:10.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-18T00:19:10.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-18T00:19:10.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-18T00:19:10.129 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:10.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:10.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-18T00:19:10.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-18T00:19:10.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-163208757251' 2026-02-18T00:19:10.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:10.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:10.261 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411335 2026-02-18T00:19:10.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411335 2026-02-18T00:19:10.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-163208757251 2-77309411335' 2026-02-18T00:19:10.262 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:10.262 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:10.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116999 2026-02-18T00:19:10.326 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116999 2026-02-18T00:19:10.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-163208757251 2-77309411335 3-115964116999' 2026-02-18T00:19:10.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:10.327 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-18T00:19:10.327 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:10.327 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:10.328 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-18T00:19:10.328 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:10.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-18T00:19:10.329 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-18T00:19:10.329 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803784 2026-02-18T00:19:10.330 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:10.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803784 2026-02-18T00:19:10.552 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:11.552 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:19:11.553 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:11.779 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-18T00:19:11.780 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:11.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-163208757251 2026-02-18T00:19:11.780 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:11.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:19:11.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-163208757251 2026-02-18T00:19:11.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:11.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-18T00:19:11.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 163208757251' 2026-02-18T00:19:11.783 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 163208757251 2026-02-18T00:19:11.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:19:12.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-18T00:19:12.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:12.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411335 2026-02-18T00:19:12.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:12.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:19:12.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411335 2026-02-18T00:19:12.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:12.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411335 2026-02-18T00:19:12.013 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411335' 2026-02-18T00:19:12.013 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 77309411335 2026-02-18T00:19:12.014 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:12.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-18T00:19:12.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:12.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116999 2026-02-18T00:19:12.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:12.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:19:12.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116999 2026-02-18T00:19:12.239 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:12.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116999 2026-02-18T00:19:12.240 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116999' 2026-02-18T00:19:12.240 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 115964116999 2026-02-18T00:19:12.241 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:19:12.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116999 -lt 115964116999 2026-02-18T00:19:12.468 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:19:12.468 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:12.468 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:12.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:19:12.792 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:19:12.793 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:19:13.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:19:13.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:19:13.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:13.018 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-72662-1 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:19:13.330 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-72662-1 2026-02-18T00:19:13.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:19:13.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:19:13.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-remove-72662-1 td/test-erasure-eio/COPY 2026-02-18T00:19:13.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:19:13.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:19:13.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-18T00:19:13.352 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-18T00:19:13.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=2 2026-02-18T00:19:13.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-72662-1 td/test-erasure-eio 2 2026-02-18T00:19:13.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-18T00:19:13.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-18T00:19:13.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-72662-1 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=2 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-72662-1 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:19:13.355 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-remove-72662-1 2026-02-18T00:19:13.356 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-remove-72662-1 2026-02-18T00:19:13.356 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:19:13.585 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:19:13.585 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:13.585 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=2 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 2 obj-remove-72662-1 remove 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-remove-72662-1 remove 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-18T00:19:13.586 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:13.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:13.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:13.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-remove-72662-1 remove 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-18T00:19:13.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-remove-72662-1 remove 2026-02-18T00:19:14.003 INFO:tasks.workunit.client.0.trial061.stdout:remove 2#2:0dea531e:::obj-remove-72662-1:head# 2026-02-18T00:19:14.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-18T00:19:14.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:14.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:19:14.040 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:14.041 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:14.042 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:start osd.2 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:14.043 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:19:14.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:19:14.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:19:14.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:19:14.044 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:19:14.056 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:14.054+0000 7f6c75e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:14.058 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:14.056+0000 7f6c75e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:14.059 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:14.057+0000 7f6c75e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:14.196 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:14.194+0000 7f6c75e22900 -1 Falling back to public interface 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:14.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:14.269 INFO:tasks.workunit.client.0.trial061.stderr:0 2026-02-18T00:19:14.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:14.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:14.491 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:14.496 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:14.494+0000 7f6c75e22900 -1 osd.2 40 log_to_monitors true 2026-02-18T00:19:15.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:15.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:15.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:15.493 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:15.493 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:15.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:15.715 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 up in weight 1 up_from 43 up_thru 35 down_at 40 last_clean_interval [18,40) [v2:127.0.0.1:6818/1574476651,v1:127.0.0.1:6819/1574476651] [v2:127.0.0.1:6820/1574476651,v1:127.0.0.1:6821/1574476651] exists,up 19a86619-98d7-4db2-bbfe-b9fe125721fc 2026-02-18T00:19:15.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:15.716 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:15.717 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:15.717 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:15.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:15.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:15.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:15.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:15.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:15.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:15.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:15.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:15.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:16.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:16.028 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:16.029 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:16.029 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:16.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:16.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:16.029 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:16.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803787 2026-02-18T00:19:16.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803787 2026-02-18T00:19:16.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787' 2026-02-18T00:19:16.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:16.093 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:16.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757254 2026-02-18T00:19:16.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757254 2026-02-18T00:19:16.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-163208757254' 2026-02-18T00:19:16.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:16.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:16.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593731 2026-02-18T00:19:16.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593731 2026-02-18T00:19:16.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-163208757254 2-184683593731' 2026-02-18T00:19:16.221 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:16.221 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:16.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117002 2026-02-18T00:19:16.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117002 2026-02-18T00:19:16.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-163208757254 2-184683593731 3-115964117002' 2026-02-18T00:19:16.286 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:16.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803787 2026-02-18T00:19:16.287 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:16.287 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:16.288 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803787 2026-02-18T00:19:16.288 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:16.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803787 2026-02-18T00:19:16.289 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803787' 2026-02-18T00:19:16.289 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.0 seq 25769803787 2026-02-18T00:19:16.289 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:16.513 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803787 2026-02-18T00:19:16.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:17.514 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:19:17.515 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:17.745 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803787 2026-02-18T00:19:17.746 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:17.746 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-163208757254 2026-02-18T00:19:17.747 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:17.747 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:19:17.747 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-163208757254 2026-02-18T00:19:17.748 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:17.749 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757254 2026-02-18T00:19:17.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 163208757254' 2026-02-18T00:19:17.750 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.1 seq 163208757254 2026-02-18T00:19:17.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:19:17.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757254 -lt 163208757254 2026-02-18T00:19:17.972 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:17.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-184683593731 2026-02-18T00:19:17.973 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:17.974 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:19:17.974 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-184683593731 2026-02-18T00:19:17.974 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:17.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593731 2026-02-18T00:19:17.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 184683593731' 2026-02-18T00:19:17.975 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.2 seq 184683593731 2026-02-18T00:19:17.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:18.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593731 -lt 184683593731 2026-02-18T00:19:18.205 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:18.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964117002 2026-02-18T00:19:18.206 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:18.206 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:19:18.207 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964117002 2026-02-18T00:19:18.207 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:18.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964117002 2026-02-18T00:19:18.208 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964117002' 2026-02-18T00:19:18.208 INFO:tasks.workunit.client.0.trial061.stderr:waiting osd.3 seq 115964117002 2026-02-18T00:19:18.209 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:19:18.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964117003 -lt 115964117002 2026-02-18T00:19:18.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:19:18.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:18.434 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:18.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:19:18.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:19:18.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:19:19.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:19:19.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:19:19.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:19.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:19.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:19:19.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:19:19.331 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:188: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-72662-1 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-72662-1 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:19:19.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-remove-72662-1 td/test-erasure-eio/COPY 2026-02-18T00:19:19.349 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:19:19.350 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:19:19.351 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-18T00:19:19.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:310: TEST_rados_get_subread_missing: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:19:19.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:19:19.352 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:19:19.625 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:19:19.633 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:19:19.911 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:19.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:19.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:19.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:19.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:20.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:20.029 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:19:20.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:19:20.031 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:19:20.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:19:20.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:19:20.033 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:19:20.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:20.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:19:20.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:19:20.034 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:20.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:19:20.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:19:20.036 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:19:20.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:19:20.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.046 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.047 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:19:20.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:19:20.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:19:20.048 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:20.049 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:20.050 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:20.050 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:19:20.051 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:19:20.051 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:19:20.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:19:20.052 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:19:20.053 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:19:20.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:20.053 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:19:20.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:19:20.054 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:20.055 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:19:20.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:19:20.056 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:19:20.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:19:20.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.057 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.057 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:19:20.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:19:20.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:19:20.058 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:19:20.059 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:19:20.059 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.059 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.060 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:19:20.060 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:19:20.061 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:19:20.062 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.082 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:20.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:19:20.108 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:19:20.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:19:20.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:19:20.109 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:19:20.110 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:19:20.110 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:19:20.111 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:19:20.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:19:20.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:19:20.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:19:20.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:19:20.158 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:20.159 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:19:20.160 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:19:20.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:19:20.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:19:20.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:19:20.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:19:20.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:19:20.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:19:20.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:19:20.302 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:20.303 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:19:20.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:19:20.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:19:20.322 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:19:20.420 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:19:20.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:21.429 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:21.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:19:21.430 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:19:21.470 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:19:21.474 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:19:21.476 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:19:20.100+0000 7f33c6c0ed80 0 load: jerasure load: lrc 2026-02-18T00:19:21.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_0 td/test-erasure-eio 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:350: TEST_rados_get_with_subreadall_eio_shard_0: local dir=td/test-erasure-eio 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:351: TEST_rados_get_with_subreadall_eio_shard_0: local shard_id=0 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:353: TEST_rados_get_with_subreadall_eio_shard_0: setup_osds 4 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:19:21.477 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:19:21.478 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:19:21.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:21.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:21.483 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:21.484 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:19:21.485 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:21.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c7313b62-c48f-44c0-ba72-ab726d5a61fe 2026-02-18T00:19:21.485 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c7313b62-c48f-44c0-ba72-ab726d5a61fe' 2026-02-18T00:19:21.486 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 c7313b62-c48f-44c0-ba72-ab726d5a61fe 2026-02-18T00:19:21.486 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:21.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCJBZVpsYdiHRAAofGxawQeLtCKZ9aORIv2PA== 2026-02-18T00:19:21.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCJBZVpsYdiHRAAofGxawQeLtCKZ9aORIv2PA=="}' 2026-02-18T00:19:21.495 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c7313b62-c48f-44c0-ba72-ab726d5a61fe -i td/test-erasure-eio/0/new.json 2026-02-18T00:19:21.597 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:21.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:19:21.605 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCJBZVpsYdiHRAAofGxawQeLtCKZ9aORIv2PA== --osd-uuid c7313b62-c48f-44c0-ba72-ab726d5a61fe 2026-02-18T00:19:21.623 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:21.621+0000 7f9184cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:21.624 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:21.622+0000 7f9184cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:21.625 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:21.623+0000 7f9184cd9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:21.625 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:21.623+0000 7f9184cd9900 -1 bdev(0x55987013ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:21.625 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:21.623+0000 7f9184cd9900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:19:22.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:19:22.034 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:22.035 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:19:22.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:19:22.035 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:22.141 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:19:22.141 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:19:22.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:22.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:22.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:22.142 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:22.157 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:22.155+0000 7feffd853900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:22.159 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:22.157+0000 7feffd853900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:22.160 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:22.158+0000 7feffd853900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:22.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:19:22.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:22.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:19:22.242 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:22.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:22.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:22.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:22.243 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:22.243 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:22.244 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:19:22.343 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:22.364 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:22.362+0000 7feffd853900 -1 Falling back to public interface 2026-02-18T00:19:22.635 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:22.633+0000 7feffd853900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:19:23.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:23.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:23.345 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:23.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:23.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:23.346 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:19:23.570 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1686083167,v1:127.0.0.1:6803/1686083167] [v2:127.0.0.1:6804/1686083167,v1:127.0.0.1:6805/1686083167] exists,up c7313b62-c48f-44c0-ba72-ab726d5a61fe 2026-02-18T00:19:23.574 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:19:23.575 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:23.576 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:23.577 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=17ef3c37-26a0-48fe-869e-a6711ca8053e 2026-02-18T00:19:23.578 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 17ef3c37-26a0-48fe-869e-a6711ca8053e' 2026-02-18T00:19:23.579 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 17ef3c37-26a0-48fe-869e-a6711ca8053e 2026-02-18T00:19:23.579 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:23.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCLBZVp3pvbIhAAZ8QB5NrffQ2drUacRDz81g== 2026-02-18T00:19:23.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCLBZVp3pvbIhAAZ8QB5NrffQ2drUacRDz81g=="}' 2026-02-18T00:19:23.587 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 17ef3c37-26a0-48fe-869e-a6711ca8053e -i td/test-erasure-eio/1/new.json 2026-02-18T00:19:23.813 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:23.821 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:19:23.822 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLBZVp3pvbIhAAZ8QB5NrffQ2drUacRDz81g== --osd-uuid 17ef3c37-26a0-48fe-869e-a6711ca8053e 2026-02-18T00:19:23.841 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:23.839+0000 7f52158fa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:23.842 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:23.840+0000 7f52158fa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:23.843 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:23.841+0000 7f52158fa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:23.844 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:23.841+0000 7f52158fa900 -1 bdev(0x55ef8e900c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:23.844 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:23.842+0000 7f52158fa900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:19:24.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:19:24.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:24.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:19:24.166 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:19:24.166 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:24.476 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:19:24.477 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:19:24.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:24.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:24.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:24.478 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:24.494 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:24.492+0000 7fa9d0362900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:24.495 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:24.493+0000 7fa9d0362900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:24.496 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:24.494+0000 7fa9d0362900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:24.628 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:24.626+0000 7fa9d0362900 -1 Falling back to public interface 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:24.698 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:24.699 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:24.699 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:24.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:24.700 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:24.922 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:24.920+0000 7fa9d0362900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:19:24.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:25.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:25.925 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:25.926 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:25.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:25.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:25.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:26.149 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4152195417,v1:127.0.0.1:6811/4152195417] [v2:127.0.0.1:6812/4152195417,v1:127.0.0.1:6813/4152195417] exists,up 17ef3c37-26a0-48fe-869e-a6711ca8053e 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:19:26.154 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:26.155 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:26.156 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:26.157 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bfc5b4ae-bdd4-4a5b-806c-b13204a9260d 2026-02-18T00:19:26.158 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 bfc5b4ae-bdd4-4a5b-806c-b13204a9260d' 2026-02-18T00:19:26.158 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 bfc5b4ae-bdd4-4a5b-806c-b13204a9260d 2026-02-18T00:19:26.158 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:26.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOBZVp5x25CRAASOCnVpSuaFDmy5W21g30+g== 2026-02-18T00:19:26.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOBZVp5x25CRAASOCnVpSuaFDmy5W21g30+g=="}' 2026-02-18T00:19:26.165 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bfc5b4ae-bdd4-4a5b-806c-b13204a9260d -i td/test-erasure-eio/2/new.json 2026-02-18T00:19:26.393 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:19:26.401 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:19:26.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOBZVp5x25CRAASOCnVpSuaFDmy5W21g30+g== --osd-uuid bfc5b4ae-bdd4-4a5b-806c-b13204a9260d 2026-02-18T00:19:26.420 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:26.418+0000 7f915840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:26.421 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:26.419+0000 7f915840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:26.422 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:26.420+0000 7f915840d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:26.423 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:26.421+0000 7f915840d900 -1 bdev(0x561d16328c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:26.423 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:26.421+0000 7f915840d900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:19:26.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:19:26.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:26.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:19:26.752 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:19:26.752 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:27.093 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:19:27.093 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:19:27.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:27.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:27.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:27.094 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:27.110 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:27.108+0000 7fc5e2a0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:27.111 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:27.109+0000 7fc5e2a0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:27.112 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:27.110+0000 7fc5e2a0f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:27.232 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:27.230+0000 7fc5e2a0f900 -1 Falling back to public interface 2026-02-18T00:19:27.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:19:27.318 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:27.319 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:27.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:27.320 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:27.510 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:27.508+0000 7fc5e2a0f900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:19:27.551 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:28.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:28.553 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:28.553 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:28.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:28.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:28.554 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:28.779 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3732197699,v1:127.0.0.1:6819/3732197699] [v2:127.0.0.1:6820/3732197699,v1:127.0.0.1:6821/3732197699] exists,up bfc5b4ae-bdd4-4a5b-806c-b13204a9260d 2026-02-18T00:19:28.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:28.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:28.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:28.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:28.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:28.784 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:28.785 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7038b152-3cf2-4d12-97d5-19c711483f72 2026-02-18T00:19:28.786 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7038b152-3cf2-4d12-97d5-19c711483f72' 2026-02-18T00:19:28.787 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 7038b152-3cf2-4d12-97d5-19c711483f72 2026-02-18T00:19:28.787 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:28.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCQBZVpzDRDLxAAhFI0l+sVIXiPCP15uq7DHA== 2026-02-18T00:19:28.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCQBZVpzDRDLxAAhFI0l+sVIXiPCP15uq7DHA=="}' 2026-02-18T00:19:28.795 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7038b152-3cf2-4d12-97d5-19c711483f72 -i td/test-erasure-eio/3/new.json 2026-02-18T00:19:29.021 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:19:29.028 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:19:29.029 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCQBZVpzDRDLxAAhFI0l+sVIXiPCP15uq7DHA== --osd-uuid 7038b152-3cf2-4d12-97d5-19c711483f72 2026-02-18T00:19:29.048 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.046+0000 7fefe411c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.049 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.047+0000 7fefe411c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.050 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.048+0000 7fefe411c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.050 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.048+0000 7fefe411c900 -1 bdev(0x55bb23614c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:29.051 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.049+0000 7fefe411c900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:19:29.371 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:19:29.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:29.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:19:29.373 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:19:29.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:29.685 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:19:29.685 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:19:29.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:29.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:29.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:29.686 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:29.701 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.700+0000 7ff435c10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.703 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.701+0000 7ff435c10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.704 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.702+0000 7ff435c10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:29.832 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:29.830+0000 7ff435c10900 -1 Falling back to public interface 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:29.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:29.910 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:29.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:29.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:30.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:30.141 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:30.139+0000 7ff435c10900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:19:31.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:31.132 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:31.132 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:31.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:31.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:31.133 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:31.356 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/671547641,v1:127.0.0.1:6827/671547641] [v2:127.0.0.1:6828/671547641,v1:127.0.0.1:6829/671547641] exists,up 7038b152-3cf2-4d12-97d5-19c711483f72 2026-02-18T00:19:31.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:31.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:31.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:31.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:19:31.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:19:31.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:19:31.403 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:19:31.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:19:31.409 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:19:22.365+0000 7feffd853900 0 load: jerasure load: lrc 2026-02-18T00:19:31.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:355: TEST_rados_get_with_subreadall_eio_shard_0: local poolname=pool-jerasure 2026-02-18T00:19:31.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:356: TEST_rados_get_with_subreadall_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:19:31.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:19:31.410 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:19:31.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:31.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:32.074 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:19:32.082 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:19:33.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:19:33.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:33.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:33.085 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:33.085 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:33.086 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:33.086 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:33.086 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:33.087 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:33.087 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:33.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:33.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:33.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:33.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:33.172 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:33.173 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:33.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:33.402 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:33.402 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:33.402 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:33.402 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:33.403 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:33.403 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:33.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-18T00:19:33.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-18T00:19:33.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-18T00:19:33.468 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:33.468 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:33.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-18T00:19:33.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-18T00:19:33.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-18T00:19:33.533 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:33.533 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:33.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:19:33.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:19:33.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331' 2026-02-18T00:19:33.597 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:33.598 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:33.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-18T00:19:33.659 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-18T00:19:33.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331 3-115964116995' 2026-02-18T00:19:33.660 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:33.661 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:33.661 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:33.661 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:33.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:33.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:33.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-18T00:19:33.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-18T00:19:33.663 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803780 2026-02-18T00:19:33.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:33.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-18T00:19:33.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:34.887 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:19:34.888 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:35.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-18T00:19:35.114 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:35.115 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-18T00:19:35.115 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:35.115 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:19:35.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-18T00:19:35.116 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:35.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-18T00:19:35.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-18T00:19:35.118 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574852 2026-02-18T00:19:35.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:19:35.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-18T00:19:35.341 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:35.341 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-18T00:19:35.342 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:35.342 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:19:35.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-18T00:19:35.343 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:35.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:19:35.344 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-18T00:19:35.344 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411331 2026-02-18T00:19:35.345 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:35.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-18T00:19:35.568 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:35.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116995 2026-02-18T00:19:35.569 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:35.569 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:19:35.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116995 2026-02-18T00:19:35.570 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:35.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116995 2026-02-18T00:19:35.571 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116995' 2026-02-18T00:19:35.571 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116995 2026-02-18T00:19:35.572 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:19:35.793 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-18T00:19:35.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:19:35.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:35.794 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:36.104 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:19:36.105 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:19:36.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:19:36.333 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:19:36.333 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:36.334 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:358: TEST_rados_get_with_subreadall_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 recovery 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72662-0 2026-02-18T00:19:36.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72662-0 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72662-0 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:19:36.648 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72662-0 td/test-erasure-eio/ORIGINAL 2026-02-18T00:19:36.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-0 td/test-erasure-eio 0 2026-02-18T00:19:36.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:19:36.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-0 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:19:36.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-0 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-0 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-0 2026-02-18T00:19:36.669 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:19:36.898 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:19:36.898 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:36.898 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:19:36.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-18T00:19:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:19:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-18T00:19:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:19:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-18T00:19:36.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:19:36.901 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:36.902 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:36.902 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:36.902 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:19:36.902 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:19:36.945 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:19:36.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:19:36.946 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:36.947 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.3.asok 2026-02-18T00:19:36.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:19:36.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-72662-0 0 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-0 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-0 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:19:36.997 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72662-0 td/test-erasure-eio/COPY 2026-02-18T00:19:37.017 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:19:37.018 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:19:37.019 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-18T00:19:37.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-72662-0 2026-02-18T00:19:37.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:19:37.019 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-0 2026-02-18T00:19:37.020 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-0 2026-02-18T00:19:37.020 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-18T00:19:37.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:19:37.248 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:37.248 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:37.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:37.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:37.248 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:37.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:37.353 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-18T00:19:37.666 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already out. 2026-02-18T00:19:37.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-72662-0 2026-02-18T00:19:37.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-18T00:19:37.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:19:37.676 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-0 2026-02-18T00:19:37.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-0 2026-02-18T00:19:37.677 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:19:37.901 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:19:37.902 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:37.902 INFO:tasks.workunit.client.0.trial061.stderr:0' 2026-02-18T00:19:37.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 0 2026-02-18T00:19:37.902 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-18T00:19:38.185 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already in. 2026-02-18T00:19:38.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-18T00:19:38.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:38.196 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:38.197 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:38.198 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:19:38.199 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:19:38.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:38.200 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:19:38.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:19:38.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:19:38.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:19:38.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:19:38.213 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:38.210+0000 7fa7e4f70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:38.215 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:38.212+0000 7fa7e4f70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:38.216 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:38.213+0000 7fa7e4f70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:38.398 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:38.394+0000 7fa7e4f70900 -1 Falling back to public interface 2026-02-18T00:19:38.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:38.426 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:38.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:38.427 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:38.647 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:38.732 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:38.729+0000 7fa7e4f70900 -1 osd.2 35 log_to_monitors true 2026-02-18T00:19:39.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:39.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:39.649 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:39.650 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:39.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:39.650 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:39.875 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 44 up_thru 20 down_at 36 last_clean_interval [18,35) [v2:127.0.0.1:6818/1813160544,v1:127.0.0.1:6819/1813160544] [v2:127.0.0.1:6820/1813160544,v1:127.0.0.1:6821/1813160544] exists,up bfc5b4ae-bdd4-4a5b-806c-b13204a9260d 2026-02-18T00:19:39.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:39.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:39.876 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:39.877 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:39.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:39.963 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:39.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:39.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:39.964 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:39.964 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:40.203 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:40.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-18T00:19:40.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-18T00:19:40.268 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-18T00:19:40.269 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:40.269 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:40.332 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-18T00:19:40.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-18T00:19:40.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855' 2026-02-18T00:19:40.333 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:40.333 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:40.398 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561027 2026-02-18T00:19:40.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561027 2026-02-18T00:19:40.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-188978561027' 2026-02-18T00:19:40.399 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:40.399 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:40.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116998 2026-02-18T00:19:40.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116998 2026-02-18T00:19:40.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-188978561027 3-115964116998' 2026-02-18T00:19:40.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:40.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-18T00:19:40.463 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:40.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:40.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-18T00:19:40.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:40.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-18T00:19:40.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-18T00:19:40.465 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803784 2026-02-18T00:19:40.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:40.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-18T00:19:40.694 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:40.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574855 2026-02-18T00:19:40.695 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:40.695 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:19:40.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574855 2026-02-18T00:19:40.696 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:40.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-18T00:19:40.697 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-18T00:19:40.698 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574855 2026-02-18T00:19:40.698 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:19:40.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-18T00:19:40.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:40.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-188978561027 2026-02-18T00:19:40.925 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:40.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:19:40.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-188978561027 2026-02-18T00:19:40.926 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:40.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561027 2026-02-18T00:19:40.928 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 188978561027' 2026-02-18T00:19:40.928 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 188978561027 2026-02-18T00:19:40.928 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:41.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 188978561027 2026-02-18T00:19:41.151 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:42.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:19:42.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:42.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 188978561027 2026-02-18T00:19:42.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:19:43.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:19:43.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:19:43.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561027 -lt 188978561027 2026-02-18T00:19:43.604 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:43.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116998 2026-02-18T00:19:43.605 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:43.606 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:19:43.606 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116998 2026-02-18T00:19:43.607 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:43.608 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116998 2026-02-18T00:19:43.608 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116998' 2026-02-18T00:19:43.608 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 115964116998 2026-02-18T00:19:43.608 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:19:43.832 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116999 -lt 115964116998 2026-02-18T00:19:43.833 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:19:43.833 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:43.833 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:19:44.152 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:19:44.374 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:19:44.374 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:19:44.375 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:19:44.375 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:360: TEST_rados_get_with_subreadall_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:19:44.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:19:44.955 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:19:44.962 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:19:45.237 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:19:45.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:19:45.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:19:45.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:19:45.246 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:19:45.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:45.247 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:45.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:45.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:45.247 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:45.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:45.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:19:45.357 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:19:45.357 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:19:45.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:19:45.359 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:19:45.359 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:19:45.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:45.360 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:19:45.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:19:45.361 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:45.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:19:45.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:19:45.363 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:19:45.373 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:19:45.373 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.373 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:19:45.375 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:19:45.376 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:19:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:19:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:19:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:19:45.376 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:19:45.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:19:45.377 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:19:45.377 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:19:45.378 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:19:45.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:19:45.379 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:19:45.379 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:45.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:19:45.380 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:19:45.380 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:19:45.381 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:19:45.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:19:45.382 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:19:45.383 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:19:45.383 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.383 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.383 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:19:45.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:19:45.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:19:45.384 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-18T00:19:45.385 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-18T00:19:45.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.386 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.386 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72662 2026-02-18T00:19:45.387 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-18T00:19:45.388 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-18T00:19:45.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-18T00:19:45.389 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:45.409 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-18T00:19:45.434 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:19:45.436 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:45.437 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:45.437 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:45.438 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.438 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.438 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:45.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:19:45.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get fsid 2026-02-18T00:19:45.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-18T00:19:45.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-18T00:19:45.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-18T00:19:45.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-18T00:19:45.482 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-18T00:19:45.483 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-18T00:19:45.483 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-18T00:19:45.484 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72662/ceph-mon.a.asok config get mon_host 2026-02-18T00:19:45.527 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-18T00:19:45.527 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-18T00:19:45.527 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-18T00:19:45.527 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-18T00:19:45.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-18T00:19:45.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-18T00:19:45.528 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:45.627 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:45.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:45.628 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:19:45.628 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-18T00:19:45.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-18T00:19:45.646 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-18T00:19:45.742 INFO:tasks.workunit.client.0.trial061.stderr:pool 'rbd' already exists 2026-02-18T00:19:45.748 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:19:46.750 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-mon.a.asok 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-18T00:19:46.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-mon.a.asok log flush 2026-02-18T00:19:46.791 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:19:46.796 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-18T00:19:46.797 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:19:45.425+0000 7fcc42a15d80 0 load: jerasure load: lrc 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_1 td/test-erasure-eio 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:364: TEST_rados_get_with_subreadall_eio_shard_1: local dir=td/test-erasure-eio 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:365: TEST_rados_get_with_subreadall_eio_shard_1: local shard_id=1 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:367: TEST_rados_get_with_subreadall_eio_shard_1: setup_osds 4 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-18T00:19:46.798 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-18T00:19:46.799 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-18T00:19:46.803 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:46.804 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:46.805 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ed19861e-7f7e-4288-a75e-cde1dfabbc31 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 ed19861e-7f7e-4288-a75e-cde1dfabbc31' 2026-02-18T00:19:46.806 INFO:tasks.workunit.client.0.trial061.stdout:add osd0 ed19861e-7f7e-4288-a75e-cde1dfabbc31 2026-02-18T00:19:46.807 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:46.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCiBZVpww19MBAAxuMSpxV+0aTUETpoGoV8RQ== 2026-02-18T00:19:46.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCiBZVpww19MBAAxuMSpxV+0aTUETpoGoV8RQ=="}' 2026-02-18T00:19:46.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ed19861e-7f7e-4288-a75e-cde1dfabbc31 -i td/test-erasure-eio/0/new.json 2026-02-18T00:19:46.919 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:46.926 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-18T00:19:46.927 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCiBZVpww19MBAAxuMSpxV+0aTUETpoGoV8RQ== --osd-uuid ed19861e-7f7e-4288-a75e-cde1dfabbc31 2026-02-18T00:19:46.945 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:46.942+0000 7f9256e15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:46.946 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:46.943+0000 7f9256e15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:46.947 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:46.944+0000 7f9256e15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:46.948 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:46.945+0000 7f9256e15900 -1 bdev(0x555616a5ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:46.948 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:46.945+0000 7f9256e15900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-18T00:19:47.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-18T00:19:47.423 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:47.424 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-18T00:19:47.424 INFO:tasks.workunit.client.0.trial061.stdout:adding osd0 key to auth repository 2026-02-18T00:19:47.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:47.530 INFO:tasks.workunit.client.0.trial061.stdout:start osd.0 2026-02-18T00:19:47.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-18T00:19:47.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:47.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:47.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:47.531 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:47.547 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:47.544+0000 7f268b816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:47.548 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:47.546+0000 7f268b816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:47.549 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:47.546+0000 7f268b816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:47.630 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:47.631 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:47.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:47.631 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:19:47.729 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:47.747 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:47.745+0000 7f268b816900 -1 Falling back to public interface 2026-02-18T00:19:48.003 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:48.000+0000 7f268b816900 -1 osd.0 0 log_to_monitors true 2026-02-18T00:19:48.730 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:48.731 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:48.731 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:48.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:48.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:48.732 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-18T00:19:48.952 INFO:tasks.workunit.client.0.trial061.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3297145193,v1:127.0.0.1:6803/3297145193] [v2:127.0.0.1:6804/3297145193,v1:127.0.0.1:6805/3297145193] exists,up ed19861e-7f7e-4288-a75e-cde1dfabbc31 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:48.957 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:48.958 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:48.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:48.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:48.959 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:48.959 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:48.959 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:48.960 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0f325f14-6feb-4bb5-8c4f-9b8be318e029 2026-02-18T00:19:48.961 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0f325f14-6feb-4bb5-8c4f-9b8be318e029' 2026-02-18T00:19:48.962 INFO:tasks.workunit.client.0.trial061.stdout:add osd1 0f325f14-6feb-4bb5-8c4f-9b8be318e029 2026-02-18T00:19:48.962 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:48.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCkBZVptBqSORAA3PuTUWeWDEF2sOH5q8sqgA== 2026-02-18T00:19:48.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCkBZVptBqSORAA3PuTUWeWDEF2sOH5q8sqgA=="}' 2026-02-18T00:19:48.968 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0f325f14-6feb-4bb5-8c4f-9b8be318e029 -i td/test-erasure-eio/1/new.json 2026-02-18T00:19:49.193 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:49.200 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-18T00:19:49.201 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCkBZVptBqSORAA3PuTUWeWDEF2sOH5q8sqgA== --osd-uuid 0f325f14-6feb-4bb5-8c4f-9b8be318e029 2026-02-18T00:19:49.219 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.216+0000 7fd62900e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:49.220 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.218+0000 7fd62900e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:49.221 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.219+0000 7fd62900e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:49.222 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.219+0000 7fd62900e900 -1 bdev(0x56413c7c0c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:49.222 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.219+0000 7fd62900e900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-18T00:19:49.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-18T00:19:49.536 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:49.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-18T00:19:49.537 INFO:tasks.workunit.client.0.trial061.stdout:adding osd1 key to auth repository 2026-02-18T00:19:49.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:49.854 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-18T00:19:49.854 INFO:tasks.workunit.client.0.trial061.stdout:start osd.1 2026-02-18T00:19:49.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:49.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:49.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:49.855 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:49.871 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.868+0000 7fd47460d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:49.872 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.869+0000 7fd47460d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:49.873 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:49.870+0000 7fd47460d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:50.006 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:50.002+0000 7fd47460d900 -1 Falling back to public interface 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:50.083 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:50.084 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:50.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:50.084 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:50.274 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:50.271+0000 7fd47460d900 -1 osd.1 0 log_to_monitors true 2026-02-18T00:19:50.306 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:51.307 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:51.308 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:51.308 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:51.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:51.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:51.309 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-18T00:19:51.533 INFO:tasks.workunit.client.0.trial061.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4175343238,v1:127.0.0.1:6811/4175343238] [v2:127.0.0.1:6812/4175343238,v1:127.0.0.1:6813/4175343238] exists,up 0f325f14-6feb-4bb5-8c4f-9b8be318e029 2026-02-18T00:19:51.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:51.537 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:51.538 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:51.539 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:51.540 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:19:51.541 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:51.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=678e1e94-fd8e-4bd8-a93d-26259be5143d 2026-02-18T00:19:51.541 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 678e1e94-fd8e-4bd8-a93d-26259be5143d' 2026-02-18T00:19:51.541 INFO:tasks.workunit.client.0.trial061.stdout:add osd2 678e1e94-fd8e-4bd8-a93d-26259be5143d 2026-02-18T00:19:51.541 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:51.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCnBZVpv1SfIBAASsHMV5mvE04iYRDGSU012w== 2026-02-18T00:19:51.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCnBZVpv1SfIBAASsHMV5mvE04iYRDGSU012w=="}' 2026-02-18T00:19:51.549 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 678e1e94-fd8e-4bd8-a93d-26259be5143d -i td/test-erasure-eio/2/new.json 2026-02-18T00:19:51.779 INFO:tasks.workunit.client.0.trial061.stdout:2 2026-02-18T00:19:51.787 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-18T00:19:51.788 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnBZVpv1SfIBAASsHMV5mvE04iYRDGSU012w== --osd-uuid 678e1e94-fd8e-4bd8-a93d-26259be5143d 2026-02-18T00:19:51.806 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:51.803+0000 7faf75964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:51.807 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:51.805+0000 7faf75964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:51.808 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:51.806+0000 7faf75964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:51.809 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:51.806+0000 7faf75964900 -1 bdev(0x56310af9ec00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:51.809 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:51.806+0000 7faf75964900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-18T00:19:52.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-18T00:19:52.120 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:52.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-18T00:19:52.121 INFO:tasks.workunit.client.0.trial061.stdout:adding osd2 key to auth repository 2026-02-18T00:19:52.121 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:52.442 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-18T00:19:52.442 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:19:52.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:52.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:52.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:52.443 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:52.459 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:52.456+0000 7fc73dc0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:52.460 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:52.457+0000 7fc73dc0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:52.461 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:52.458+0000 7fc73dc0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:52.611 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:52.608+0000 7fc73dc0d900 -1 Falling back to public interface 2026-02-18T00:19:52.666 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:52.667 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:52.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:52.668 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:52.890 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:52.945 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:52.942+0000 7fc73dc0d900 -1 osd.2 0 log_to_monitors true 2026-02-18T00:19:53.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:53.891 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:53.892 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:53.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:53.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:53.893 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:19:54.112 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3284147382,v1:127.0.0.1:6819/3284147382] [v2:127.0.0.1:6820/3284147382,v1:127.0.0.1:6821/3284147382] exists,up 678e1e94-fd8e-4bd8-a93d-26259be5143d 2026-02-18T00:19:54.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:54.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:54.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:54.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-18T00:19:54.116 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-18T00:19:54.117 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-18T00:19:54.118 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a4e759ae-2712-45fc-a579-a0ee23eec300 2026-02-18T00:19:54.119 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 a4e759ae-2712-45fc-a579-a0ee23eec300' 2026-02-18T00:19:54.120 INFO:tasks.workunit.client.0.trial061.stdout:add osd3 a4e759ae-2712-45fc-a579-a0ee23eec300 2026-02-18T00:19:54.120 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-18T00:19:54.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCqBZVpxA5/BxAAwHx9pwdSZYzf1KPcxk3hJQ== 2026-02-18T00:19:54.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCqBZVpxA5/BxAAwHx9pwdSZYzf1KPcxk3hJQ=="}' 2026-02-18T00:19:54.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a4e759ae-2712-45fc-a579-a0ee23eec300 -i td/test-erasure-eio/3/new.json 2026-02-18T00:19:54.353 INFO:tasks.workunit.client.0.trial061.stdout:3 2026-02-18T00:19:54.361 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-18T00:19:54.362 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCqBZVpxA5/BxAAwHx9pwdSZYzf1KPcxk3hJQ== --osd-uuid a4e759ae-2712-45fc-a579-a0ee23eec300 2026-02-18T00:19:54.380 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:54.377+0000 7fc2f4a0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:54.381 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:54.378+0000 7fc2f4a0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:54.382 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:54.379+0000 7fc2f4a0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:54.383 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:54.380+0000 7fc2f4a0d900 -1 bdev(0x55e67c38cc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-18T00:19:54.383 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:54.380+0000 7fc2f4a0d900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-18T00:19:54.707 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-18T00:19:54.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-18T00:19:54.708 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-18T00:19:54.709 INFO:tasks.workunit.client.0.trial061.stdout:adding osd3 key to auth repository 2026-02-18T00:19:54.709 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-18T00:19:55.030 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-18T00:19:55.031 INFO:tasks.workunit.client.0.trial061.stdout:start osd.3 2026-02-18T00:19:55.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:19:55.031 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-18T00:19:55.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-18T00:19:55.032 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-18T00:19:55.047 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:55.044+0000 7f34b88f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:55.049 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:55.046+0000 7f34b88f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:55.050 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:55.047+0000 7f34b88f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:19:55.184 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:55.181+0000 7f34b88f6900 -1 Falling back to public interface 2026-02-18T00:19:55.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-18T00:19:55.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:19:55.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-18T00:19:55.254 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:19:55.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:19:55.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:55.255 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:19:55.255 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:19:55.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:55.256 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:55.479 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:19:55.509 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:19:55.506+0000 7f34b88f6900 -1 osd.3 0 log_to_monitors true 2026-02-18T00:19:56.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:19:56.480 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:19:56.481 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:19:56.481 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:19:56.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:19:56.482 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-18T00:19:56.712 INFO:tasks.workunit.client.0.trial061.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2596306153,v1:127.0.0.1:6827/2596306153] [v2:127.0.0.1:6828/2596306153,v1:127.0.0.1:6829/2596306153] exists,up a4e759ae-2712-45fc-a579-a0ee23eec300 2026-02-18T00:19:56.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:19:56.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:19:56.714 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:19:56.714 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.0.asok 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-18T00:19:56.715 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.0.asok log flush 2026-02-18T00:19:56.760 INFO:tasks.workunit.client.0.trial061.stdout:{} 2026-02-18T00:19:56.763 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-18T00:19:56.765 INFO:tasks.workunit.client.0.trial061.stdout:2026-02-18T00:19:47.747+0000 7f268b816900 0 load: jerasure load: lrc 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:369: TEST_rados_get_with_subreadall_eio_shard_1: local poolname=pool-jerasure 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:370: TEST_rados_get_with_subreadall_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-18T00:19:56.767 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-18T00:19:57.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:57.054 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-18T00:19:57.424 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' already exists 2026-02-18T00:19:57.433 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-18T00:19:58.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-18T00:19:58.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:19:58.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:19:58.435 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:19:58.436 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:19:58.436 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:19:58.437 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:19:58.437 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:19:58.437 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:19:58.437 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:19:58.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:19:58.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:19:58.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:19:58.522 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:19:58.523 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:19:58.523 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:19:58.750 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:58.751 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:19:58.816 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-18T00:19:58.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-18T00:19:58.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-18T00:19:58.817 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:58.817 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:19:58.880 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-18T00:19:58.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-18T00:19:58.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-18T00:19:58.881 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:58.881 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:19:58.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-18T00:19:58.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-18T00:19:58.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331' 2026-02-18T00:19:58.944 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:19:58.944 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:19:59.009 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-18T00:19:59.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-18T00:19:59.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331 3-107374182403' 2026-02-18T00:19:59.010 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:19:59.010 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:59.010 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:19:59.011 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:19:59.011 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-18T00:19:59.012 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:19:59.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-18T00:19:59.012 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-18T00:19:59.013 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803780 2026-02-18T00:19:59.013 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:19:59.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-18T00:19:59.237 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:20:00.238 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:20:00.238 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:20:00.463 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-18T00:20:00.464 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:00.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-18T00:20:00.464 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:00.465 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:20:00.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-18T00:20:00.466 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:00.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-18T00:20:00.467 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-18T00:20:00.467 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574852 2026-02-18T00:20:00.467 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:20:00.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-18T00:20:00.689 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:00.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-18T00:20:00.690 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:00.691 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:20:00.691 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-18T00:20:00.692 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:00.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-18T00:20:00.693 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-18T00:20:00.693 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 77309411331 2026-02-18T00:20:00.693 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:20:00.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-18T00:20:00.920 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:00.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182403 2026-02-18T00:20:00.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:00.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:20:00.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182403 2026-02-18T00:20:00.922 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:00.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182403 2026-02-18T00:20:00.924 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-18T00:20:00.924 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182403 2026-02-18T00:20:00.924 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:20:01.148 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-18T00:20:01.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:20:01.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:20:01.149 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:20:01.461 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:20:01.462 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:20:01.683 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:20:01.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:20:01.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:20:01.684 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:20:02.005 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:372: TEST_rados_get_with_subreadall_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 recovery 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72662-1 2026-02-18T00:20:02.006 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72662-1 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-18T00:20:02.007 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72662-1 td/test-erasure-eio/ORIGINAL 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72662-1 td/test-erasure-eio 1 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72662-1 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-18T00:20:02.026 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-1 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.027 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:20:02.249 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-18T00:20:02.250 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:20:02.252 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:20:02.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:20:02.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:20:02.254 INFO:tasks.workunit.client.0.trial061.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:20:02.254 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:20:02.254 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72662/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-18T00:20:02.303 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-18T00:20:02.303 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-18T00:20:02.304 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-18T00:20:02.304 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-18T00:20:02.304 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-18T00:20:02.304 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72662/ceph-osd.1.asok 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-18T00:20:02.305 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72662/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72662-1 1 2026-02-18T00:20:02.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-18T00:20:02.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-18T00:20:02.354 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72662-1 2026-02-18T00:20:02.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-18T00:20:02.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-18T00:20:02.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72662-1 td/test-erasure-eio/COPY 2026-02-18T00:20:02.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-18T00:20:02.372 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-18T00:20:02.373 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-18T00:20:02.374 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.374 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:20:02.374 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-1 2026-02-18T00:20:02.374 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-1 2026-02-18T00:20:02.375 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:20:02.600 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:20:02.600 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:20:02.600 INFO:tasks.workunit.client.0.trial061.stderr:2' 2026-02-18T00:20:02.600 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:20:02.601 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:20:02.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:20:02.907 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-18T00:20:03.186 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already out. 2026-02-18T00:20:03.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-72662-1 2026-02-18T00:20:03.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-18T00:20:03.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-18T00:20:03.195 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72662-1 2026-02-18T00:20:03.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72662-1 2026-02-18T00:20:03.196 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-18T00:20:03.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-18T00:20:03.425 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:20:03.425 INFO:tasks.workunit.client.0.trial061.stderr:0' 2026-02-18T00:20:03.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 0 2026-02-18T00:20:03.425 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-18T00:20:03.710 INFO:tasks.workunit.client.0.trial061.stderr:osd.2 is already in. 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-18T00:20:03.722 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-18T00:20:03.723 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-18T00:20:03.724 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-18T00:20:03.725 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-18T00:20:03.725 INFO:tasks.workunit.client.0.trial061.stdout:start osd.2 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5a5c242f-b054-4600-842d-e83c763bb721 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72662/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-18T00:20:03.726 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-18T00:20:03.738 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:20:03.735+0000 7f55d58e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:20:03.740 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:20:03.737+0000 7f55d58e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:20:03.741 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:20:03.739+0000 7f55d58e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-18T00:20:03.931 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:20:03.928+0000 7f55d58e7900 -1 Falling back to public interface 2026-02-18T00:20:03.948 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-18T00:20:03.949 INFO:tasks.workunit.client.0.trial061.stdout:0 2026-02-18T00:20:03.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:20:03.950 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:20:04.171 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-18T00:20:04.322 INFO:tasks.workunit.client.0.trial061.stderr:2026-02-18T00:20:04.319+0000 7f55d58e7900 -1 osd.2 32 log_to_monitors true 2026-02-18T00:20:05.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-18T00:20:05.173 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-18T00:20:05.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-18T00:20:05.174 INFO:tasks.workunit.client.0.trial061.stdout:1 2026-02-18T00:20:05.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-18T00:20:05.174 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-18T00:20:05.406 INFO:tasks.workunit.client.0.trial061.stdout:osd.2 up in weight 1 up_from 41 up_thru 19 down_at 33 last_clean_interval [18,32) [v2:127.0.0.1:6818/516023699,v1:127.0.0.1:6819/516023699] [v2:127.0.0.1:6820/516023699,v1:127.0.0.1:6821/516023699] exists,up 678e1e94-fd8e-4bd8-a93d-26259be5143d 2026-02-18T00:20:05.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-18T00:20:05.407 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-18T00:20:05.408 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-18T00:20:05.494 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:1 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:2 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:3' 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-18T00:20:05.716 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:20:05.717 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-18T00:20:05.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-18T00:20:05.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-18T00:20:05.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-18T00:20:05.783 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:20:05.783 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-18T00:20:05.844 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-18T00:20:05.844 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-18T00:20:05.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855' 2026-02-18T00:20:05.845 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:20:05.845 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-18T00:20:05.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659139 2026-02-18T00:20:05.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659139 2026-02-18T00:20:05.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-176093659139' 2026-02-18T00:20:05.909 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-18T00:20:05.909 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-18T00:20:05.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182406 2026-02-18T00:20:05.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182406 2026-02-18T00:20:05.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-176093659139 3-107374182406' 2026-02-18T00:20:05.975 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:05.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-18T00:20:05.976 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:05.977 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-18T00:20:05.977 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-18T00:20:05.977 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:05.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-18T00:20:05.978 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-18T00:20:05.979 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.0 seq 25769803784 2026-02-18T00:20:05.979 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:20:06.203 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-18T00:20:06.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:20:07.204 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-18T00:20:07.205 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:20:07.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-18T00:20:07.437 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-18T00:20:08.438 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-18T00:20:08.438 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-18T00:20:08.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-18T00:20:08.662 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:08.662 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574855 2026-02-18T00:20:08.663 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:08.663 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-18T00:20:08.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574855 2026-02-18T00:20:08.664 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:08.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-18T00:20:08.665 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-18T00:20:08.665 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.1 seq 55834574855 2026-02-18T00:20:08.666 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-18T00:20:08.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-18T00:20:08.895 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:08.896 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-176093659139 2026-02-18T00:20:08.896 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:08.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-18T00:20:08.897 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-176093659139 2026-02-18T00:20:08.897 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:08.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659139 2026-02-18T00:20:08.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 176093659139' 2026-02-18T00:20:08.899 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.2 seq 176093659139 2026-02-18T00:20:08.899 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-18T00:20:09.126 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659139 -lt 176093659139 2026-02-18T00:20:09.127 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-18T00:20:09.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182406 2026-02-18T00:20:09.127 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-18T00:20:09.128 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-18T00:20:09.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182406 2026-02-18T00:20:09.129 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-18T00:20:09.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182406 2026-02-18T00:20:09.130 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182406' 2026-02-18T00:20:09.131 INFO:tasks.workunit.client.0.trial061.stdout:waiting osd.3 seq 107374182406 2026-02-18T00:20:09.131 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-18T00:20:09.355 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182407 -lt 107374182406 2026-02-18T00:20:09.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-18T00:20:09.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:20:09.356 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:20:09.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-18T00:20:09.680 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-18T00:20:09.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-18T00:20:09.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-18T00:20:09.680 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-18T00:20:09.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-18T00:20:09.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-18T00:20:09.681 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-18T00:20:09.900 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-18T00:20:09.901 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-18T00:20:09.901 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-18T00:20:09.901 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-18T00:20:10.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-18T00:20:10.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-18T00:20:10.216 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-18T00:20:10.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:374: TEST_rados_get_with_subreadall_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-18T00:20:10.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-18T00:20:10.217 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-18T00:20:10.488 INFO:tasks.workunit.client.0.trial061.stderr:pool 'pool-jerasure' does not exist 2026-02-18T00:20:10.497 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-18T00:20:10.773 INFO:tasks.workunit.client.0.trial061.stderr:erasure-code-profile myprofile does not exist 2026-02-18T00:20:10.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-18T00:20:10.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:20:10.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-18T00:20:10.781 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:20:10.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:20:10.782 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:20:10.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:20:10.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:20:10.782 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:20:10.892 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:20:10.893 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:20:10.894 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:20:10.894 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:20:10.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:20:10.896 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:20:10.896 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:20:10.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:20:10.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:20:10.897 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:20:10.897 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:20:10.898 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:20:10.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-18T00:20:10.899 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:20:10.910 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:20:10.910 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:20:10.910 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:20:10.910 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:20:10.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:20:10.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:20:10.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-18T00:20:10.912 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-eio 0 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-18T00:20:10.913 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-18T00:20:10.914 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-18T00:20:10.914 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-18T00:20:10.915 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-18T00:20:10.915 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-18T00:20:10.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-18T00:20:10.916 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-18T00:20:10.916 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-18T00:20:10.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:20:10.917 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-18T00:20:10.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-18T00:20:10.918 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T00:20:10.918 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:20:10.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-18T00:20:10.919 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-18T00:20:10.920 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-18T00:20:10.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-18T00:20:10.921 INFO:tasks.workunit.client.0.trial061.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72662 2026-02-18T00:20:10.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72662 2026-02-18T00:20:10.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-18T00:20:10.921 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-18T00:20:10.922 INFO:tasks.workunit.client.0.trial061.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-18T00:20:10.923 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-18T00:20:10.923 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-18T00:20:10.990 INFO:tasks.workunit:Stopping ['erasure-code'] on client.0... 2026-02-18T00:20:10.991 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-18T00:20:11.352 DEBUG:teuthology.parallel:result is None 2026-02-18T00:20:11.352 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T00:20:11.377 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T00:20:11.378 DEBUG:teuthology.orchestra.run.trial061:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-18T00:20:11.435 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-18T00:20:11.436 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T00:20:11.449 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T00:20:11.450 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T00:20:11.602 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T00:20:11.613 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T00:20:11.613 DEBUG:teuthology.orchestra.run.trial061:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T00:20:11.629 INFO:teuthology.orchestra.run.trial061.stderr:bash: line 1: ntpq: command not found 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:=============================================================================== 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:^- time-usw1.crimpac.net 2 6 377 37 -1014us[-1006us] +/- 64ms 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:^* chi2.us.ntp.li 2 6 377 37 -637us[ -630us] +/- 11ms 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:^- 23.186.168.131 2 6 377 35 +1239us[+1239us] +/- 67ms 2026-02-18T00:20:11.651 INFO:teuthology.orchestra.run.trial061.stdout:^+ 172-104-209-204.ip.linod> 4 6 377 35 +1519us[+1519us] +/- 30ms 2026-02-18T00:20:11.652 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T00:20:11.663 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T00:20:11.663 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T00:20:11.677 DEBUG:teuthology.orchestra.run.trial061:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T00:20:11.734 DEBUG:teuthology.orchestra.run.trial061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-18T00:20:11.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:20:11.798 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T00:20:11.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T00:20:11.826 INFO:teuthology.task.internal:Duration was 889.335321 seconds 2026-02-18T00:20:11.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T00:20:11.842 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T00:20:11.843 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T00:20:11.877 INFO:teuthology.orchestra.run.trial061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T00:20:12.235 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T00:20:12.235 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial061.front.sepia.ceph.com 2026-02-18T00:20:12.235 DEBUG:teuthology.orchestra.run.trial061:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T00:20:12.293 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T00:20:12.294 DEBUG:teuthology.orchestra.run.trial061:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T00:20:12.374 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T00:20:12.375 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T00:20:12.438 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T00:20:12.439 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T00:20:12.439 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T00:20:12.440 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T00:20:12.440 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T00:20:12.443 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T00:20:12.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T00:20:12.460 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T00:20:12.460 DEBUG:teuthology.orchestra.run.trial061:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T00:20:12.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T00:20:12.524 DEBUG:teuthology.orchestra.run.trial061:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:20:12.572 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = core 2026-02-18T00:20:12.582 DEBUG:teuthology.orchestra.run.trial061:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T00:20:12.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T00:20:12.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T00:20:12.653 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T00:20:12.655 DEBUG:teuthology.misc:Transferring archived files from trial061:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:14:21-rados-20.2.1_2.17.26-baseline_2-distro-default-trial/54106/remote/trial061 2026-02-18T00:20:12.656 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T00:20:12.711 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T00:20:12.711 DEBUG:teuthology.orchestra.run.trial061:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T00:20:12.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T00:20:12.781 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T00:20:12.782 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T00:20:12.797 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T00:20:12.797 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T00:20:12.821 INFO:teuthology.orchestra.run.trial061.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 00:20 /home/ubuntu/cephtest 2026-02-18T00:20:12.822 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T00:20:12.839 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T00:20:12.874 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} duration: 889.3353209495544 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-18T00:20:12.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T00:20:12.987 INFO:teuthology.run:pass